-- Logs begin at Fri 2022-10-14 17:15:32 UTC, end at Fri 2022-10-14 18:11:06 UTC. -- Oct 14 17:41:17.058214 dv-cinder-749155-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 14 17:41:17.065502 dv-cinder-749155-15-smb devstack@keystone.service[81343]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 17:41:17 2022] *** Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: nodename: dv-cinder-749155-15-smb Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: machine: x86_64 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: clock source: unix Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: pcre jit disabled Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: detected number of CPU cores: 4 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: current working directory: / Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: detected binary path: /usr/bin/uwsgi-core Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: your processes number limit is 47680 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: your memory page size is 4096 bytes Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: detected max file descriptor number: 2048 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: lock engine: pthread robust mutexes Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: thunder lock: enabled Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 14 17:41:17.070360 dv-cinder-749155-15-smb devstack@keystone.service[81343]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 17:41:17.113546 dv-cinder-749155-15-smb devstack@keystone.service[81343]: Python main interpreter initialized at 0x5610e754f9c0 Oct 14 17:41:17.113546 dv-cinder-749155-15-smb devstack@keystone.service[81343]: python threads support enabled Oct 14 17:41:17.113546 dv-cinder-749155-15-smb devstack@keystone.service[81343]: your server socket listen backlog is limited to 100 connections Oct 14 17:41:17.113546 dv-cinder-749155-15-smb devstack@keystone.service[81343]: your mercy for graceful operations on workers is 90 seconds Oct 14 17:41:17.113940 dv-cinder-749155-15-smb devstack@keystone.service[81343]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 17:41:17.114025 dv-cinder-749155-15-smb devstack@keystone.service[81343]: *** Operational MODE: preforking *** Oct 14 17:41:17.114263 dv-cinder-749155-15-smb devstack@keystone.service[81343]: *** uWSGI is running in multiple interpreter mode *** Oct 14 17:41:17.114263 dv-cinder-749155-15-smb devstack@keystone.service[81343]: spawned uWSGI master process (pid: 81343) Oct 14 17:41:17.114466 dv-cinder-749155-15-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 14 17:41:17.115316 dv-cinder-749155-15-smb devstack@keystone.service[81343]: spawned uWSGI worker 1 (pid: 81361, cores: 1) Oct 14 17:41:17.115406 dv-cinder-749155-15-smb devstack@keystone.service[81343]: spawned uWSGI worker 2 (pid: 81362, cores: 1) Oct 14 17:41:17.118817 dv-cinder-749155-15-smb devstack@keystone.service[81343]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 17:41:21.443591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:41:21.443591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: from cryptography.utils import int_from_bytes Oct 14 17:41:21.444517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:41:21.444517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 14 17:41:21.445011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:41:21.445011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: from cryptography.utils import int_from_bytes Oct 14 17:41:21.445129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 17:41:21.445129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: from cryptography.utils import int_from_bytes Oct 14 17:41:21.494855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:41:21.495037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 17:41:21.495113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:41:21.495189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 17:41:21.495256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] command line args: [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:41:21.495338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] command line args: [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 17:41:21.495577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:41:21.495673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 17:41:21.495735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ================================================================================ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:41:21.495792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ================================================================================ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 17:41:21.495946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] admin_token = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_dir = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_dir = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] config_source = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] config_source = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] debug = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] debug = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.496901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_config_append = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_config_append = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.499944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_dir = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_dir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.500995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.501060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.501124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.501181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.502402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.502641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.502810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.503040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.503209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.503456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.503650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.503888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.504901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.505251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.505485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.505653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.505849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] publish_errors = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.506077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] publish_errors = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.506077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.506433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.506627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.506821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.507986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] standard_threads = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.508114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] standard_threads = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.508243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.508371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.508550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_journal = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_journal = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_json = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_json = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_stderr = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_stderr = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] use_syslog = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.509981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] use_syslog = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.510045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.510103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 17:41:21.510158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510575 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.510986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.511979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.512960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.513964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.514805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.515982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.516977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.517110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.517245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.517393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.517638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.517848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.518917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.519887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.520015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.521401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.521579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.521816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.521987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.522182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.522375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.522656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.522861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.523065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.523065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.523586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.523777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.523968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.524174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.524410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.524582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.524809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.525018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.525222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.525390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.525623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.525823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.526913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.527962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.528925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.529879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.530946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.531916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.532972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.533618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.533779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.533975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.534977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.535999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.536909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.537979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.external = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.external = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.538936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.password = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.539924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.password = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] auth.token = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] auth.token = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.540912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.541964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.542947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.543904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.544938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.545912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.546992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.547943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.548092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.548226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.548374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.548506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.548740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.549397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.549540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.549704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.549836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.549973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.550927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.551955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.552931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.553985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.554915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.555922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.556986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.557907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.558960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.559897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.560961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.561893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.562966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.563928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.564971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.565914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.566958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.567972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.568887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.569966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.570999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.571958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.572875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.573987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.574916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.575874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.576931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.577903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.578965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.579805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.580917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.581971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.582897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.583884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.584955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.585991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.586916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.587865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.588941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.589903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.590905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.591962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.592963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.593964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.594949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.595084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.595228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.595388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.596898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 17:41:21.597552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 17:41:21.610755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.610984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.611326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.611850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.612092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.612323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.619643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.620614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.648660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.648916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.649615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.649850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.702745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.702935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.753408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.753640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.754435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.754742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.909275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.909528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.909614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.909741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.909949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.910880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.911162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.933743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.933980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.934933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.935055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.935238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.935545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.935835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.946820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.947428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.959592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.959715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.959788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.959939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.960067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.960149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.960341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.960465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.960795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.961012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.961095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.961228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.961311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.961590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 17:41:21.978677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.978955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 17:41:21.979418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.979688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 17:41:21.980038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.980372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.980703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.981030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.982425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.982638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 17:41:21.982980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.983179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 17:41:21.983492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.983758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.984021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.984282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.992019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.992372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.992718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.993074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.994452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.994732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.995005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:21.995309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.000480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.002952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.004134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.004496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.004855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.005209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.005565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.005897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.005978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.006252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.006334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.006530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.006609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.006815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.006951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.007945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.008219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.008494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.008763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.030895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.032085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.032543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.032902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.033603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.033897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.037981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.038338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.038692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.038774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.038985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.039299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.045306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.045683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.045892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.046187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.052398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.052773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.052856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.053075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.053155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.053373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.053512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.053663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.053940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.054863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.055171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.071188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.071361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.071480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.071699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.075305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.075676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.078497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.078792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.079086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.079475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.083103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.083819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.086479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.087369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.089684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.089988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.090275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.090561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.090841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.090960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.091123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.091322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.091674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.092029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.092378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.092726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.107411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.107701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.107967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.108230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.109574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.109939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.110280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.110615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.115775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.117285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.118269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.118783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.119060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.120082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.121714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.121836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.122103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.122235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.122395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.122678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.123062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.125212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.125571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.125937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.126311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.126821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.134504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.134790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.135072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.135387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.135770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.136060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.136342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.138530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.138890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.139257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.139625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.140078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.140441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.140792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.152036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.155214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.156622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.158671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.160166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.160427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.161641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.161923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.162321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.163627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.165162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.166901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.167297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.167775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.168717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.170181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.173085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.173483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.174309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.174589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.175252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.176826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.179834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.180304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.180662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.181012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.182446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.182739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.183023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.189133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.189598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.189952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.190070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.190244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.190528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.190806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.191080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.191375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.191650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.191938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.192217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.192489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.192767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.193035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.193300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.193560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.197802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 17:41:22.198186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.198526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.198888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.199233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.199601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.199943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.200288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.200625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.200980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.201331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.201662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.201995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.202363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 17:41:22.228607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610e754f9c0 pid: 81362 (default app) Oct 14 17:41:22.231867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87cef-7787-4db4-9b96-368f87736121 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:22.232155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87cef-7787-4db4-9b96-368f87736121 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:22.232426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87cef-7787-4db4-9b96-368f87736121 None None] PATH_INFO: `/v3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:22.238833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Fri Oct 14 17:41:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:22.239002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610e754f9c0 pid: 81361 (default app) Oct 14 17:41:29.124968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:29.125467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:29.125568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:29.127340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:41:29.134641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:29.135220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:29.135220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:29.203230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: INFO dbcounter [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] Registered counter for database keystone Oct 14 17:41:29.222673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:41:29.228955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writer thread running {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:41:29.410166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG passlib.handlers.bcrypt [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81361) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 17:41:29.410478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG passlib.handlers.bcrypt [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81361) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 17:41:29.468492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:29.470090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:29.597283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:41:29.984972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:30.053141 dv-cinder-749155-15-smb devstack@keystone.service[81362]: INFO dbcounter [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] Registered counter for database keystone Oct 14 17:41:30.073985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG oslo_db.sqlalchemy.engines [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 17:41:30.080625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writer thread running {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 17:41:30.199343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5857b0-c1ca-4443-aa52-3020e4766379 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:30.203616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:30.204232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:30.204508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:30.205330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:30.213741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:30.264534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 17:41:30.264820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d6a62-20b1-4502-b2e9-0de122a3c22b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:30.274423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Oct 14 17:41:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 17:41:30.280412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:30.297524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60feb75-700d-4e90-a5c7-b211ca9cff66 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:30.301913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:30.303141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:30.303467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:30.303734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] PATH_INFO: `/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:30.305164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] RBAC: Authorizing `identity:get_project(project_id=b8a3a4fbbeb945ec99d62464efbbf393)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:30.358461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 17:41:30.358810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c0059-211d-45d8-b587-7836c2d2561c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:30.363416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:41:30 2022] GET /identity/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:41:32.494766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8fcb-ec77-4c19-9e62-64a0bbf9d86e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:32.495356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8fcb-ec77-4c19-9e62-64a0bbf9d86e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:32.495356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb8fcb-ec77-4c19-9e62-64a0bbf9d86e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:32.499396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:32.505400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:32.505827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:32.505946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:32.526464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:32.528003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:32.536345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:41:32.810270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb8fcb-ec77-4c19-9e62-64a0bbf9d86e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:32.822337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb8fcb-ec77-4c19-9e62-64a0bbf9d86e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:32.826532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:32.827132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:32.827445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:32.827722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:32.835490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:32.837503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647142a5-d314-4502-b567-0a08666317d7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:32.846748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Oct 14 17:41:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:41:32.852074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:32.861741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275af53-3a5d-40bf-afc9-649fb50fc7e7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:32.865989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:32.866602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:32.866877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:32.867143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] PATH_INFO: `/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:32.868462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf4c2ccaa5c44feca15e4abc0bc69573)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:32.870256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997ab47-e45c-4dc2-a12d-037e192b7dc0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:32.871784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Fri Oct 14 17:41:32 2022] GET /identity/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:35.074211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4730e-020c-4e6e-aace-55d0c8fb0d25 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.074724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4730e-020c-4e6e-aace-55d0c8fb0d25 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.074822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4730e-020c-4e6e-aace-55d0c8fb0d25 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.076280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:41:35.081459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.081883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.082014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.100429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:35.101592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:35.120994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d5c-fb5c-4f81-bf27-a310271c3345 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.121280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d5c-fb5c-4f81-bf27-a310271c3345 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.121562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d5c-fb5c-4f81-bf27-a310271c3345 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.122878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:41:35.128006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.128294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.128572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.170116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 17:41:35.170509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG passlib.handlers.bcrypt [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 17:41:35.183323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:35.220014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:35.222177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:35.318779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:41:35.451654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.477940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:35.557563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a2826-1ced-4b60-91ca-77ae156aa872 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:35.584793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.590730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:35.591393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.591670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.591934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.603465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:35.612248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:35.613253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:41:35.614850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:35.619160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.692557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698614d8-731a-45ff-ac5c-3f1ae8663625 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:35.694975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:35.698751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:35.718787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153f42a-895f-4053-bf3f-153288d1adc1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:35.733426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:35.734286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.734566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.734836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.735912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:35.737329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:35.748084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:41:35.748084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:41:35.748084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [parameters: {'id': '6985f4ad6f814813a1956f9b948bc49a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 17:41:35.748084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 17:41:35.753848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:35.754476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.754753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.755017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.755708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:35.756007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:35.757375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:41:35.766892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 17:41:35.768662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 17:41:35.769724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 17:41:35.770937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 17:41:35.772246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:41:35.773295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': '6985f4ad6f814813a1956f9b948bc49a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 17:41:35.774641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:35.775968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.777300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 9/15] 10.222.0.26 () {60 vars in 1137 bytes} [Fri Oct 14 17:41:35 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:41:35.779207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 7/16] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:41:35.779326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.779421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.873194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba681f9-6689-469c-aed8-b28b39a29baf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:35.874457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e33fb0-b679-401e-825f-823106fb1abf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:35.906777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:35.908177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.908285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:35.908560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.908841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:35.908952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.909119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:35.909392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] PATH_INFO: `/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:35.910509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] RBAC: Authorizing `identity:get_user(user_id=cf4c2ccaa5c44feca15e4abc0bc69573)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:35.911987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:35.913549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 8/17] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:41:35.918985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.927200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:35.928707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:35.933447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:41:35.945475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:35.946375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:41:35.947217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:41:35.947217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:41:35.947217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:35.947217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:35.952397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:35.975785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:36.019567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003dc79-b0cd-4868-9bc2-8d3fb4894629 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:36.052684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:36.053313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:36.053592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:36.053862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:36.054978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:36.055969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadfbf-f601-4ed4-9222-cbdb0c59195c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:36.056504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:36.058049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:41:36.063713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:36.089848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:36.090449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:36.090728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:36.090995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:36.091948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:36.091948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:36.093305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c36-5724-4cba-929d-68c86544c331 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:36.110027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:41:36.151323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:36.171778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9458c-538b-4f5a-a678-b8d3fe946834 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:36.207909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:36.208583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:36.208865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:36.209143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] PATH_INFO: `/v3/domains/default/users/cf4c2ccaa5c44feca15e4abc0bc69573/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:36.211420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cf4c2ccaa5c44feca15e4abc0bc69573, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:36.212882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bea5c-2704-4966-bdc1-5aa771216c20 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:36.328020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1361 bytes} [Fri Oct 14 17:41:36 2022] PUT /identity/v3/domains/default/users/cf4c2ccaa5c44feca15e4abc0bc69573/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:41:38.628551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19741-8690-4ea1-b010-22897eb4fd91 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:38.628551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19741-8690-4ea1-b010-22897eb4fd91 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:38.628551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19741-8690-4ea1-b010-22897eb4fd91 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:38.628551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:38.635194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528015f-29f1-44c9-8723-160225164566 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:38.636028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528015f-29f1-44c9-8723-160225164566 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:38.636506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528015f-29f1-44c9-8723-160225164566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:38.659579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f528015f-29f1-44c9-8723-160225164566 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:38.661407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f528015f-29f1-44c9-8723-160225164566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:38.747187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:38.770400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d8a2-27b8-4008-bdb1-a9cb711b2591 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:38.770679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d8a2-27b8-4008-bdb1-a9cb711b2591 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:38.770955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d8a2-27b8-4008-bdb1-a9cb711b2591 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:38.772316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:38.788760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297145a-cf50-4a63-a55f-3b16cda1d135 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:38.789046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297145a-cf50-4a63-a55f-3b16cda1d135 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:38.789323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297145a-cf50-4a63-a55f-3b16cda1d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:38.808191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b297145a-cf50-4a63-a55f-3b16cda1d135 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:38.809382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b297145a-cf50-4a63-a55f-3b16cda1d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:38.884097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:38.892052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:39.057475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd527-b647-46aa-8301-9d4897a572ea None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.057831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd527-b647-46aa-8301-9d4897a572ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.058031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd527-b647-46aa-8301-9d4897a572ea None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.059595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:39.065257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103916-9904-4112-a93b-3c525e1284de None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.065545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103916-9904-4112-a93b-3c525e1284de None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.065829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103916-9904-4112-a93b-3c525e1284de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.085125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6b103916-9904-4112-a93b-3c525e1284de None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:39.086612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6b103916-9904-4112-a93b-3c525e1284de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:39.157228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:39.165956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd527-b647-46aa-8301-9d4897a572ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.253187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:39.274178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd527-b647-46aa-8301-9d4897a572ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:39.309422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:39.310057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.310336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.310609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.321146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:39.322627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:41:39.338675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:39.339533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:41:39.340338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:41:39.340338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:41:39.340338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:39.340338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 15/28] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:39.348469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103916-9904-4112-a93b-3c525e1284de None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.456659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103916-9904-4112-a93b-3c525e1284de None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:39.477302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.510810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:39.519046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:39.520209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.520723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.521099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.521859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:39.522595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:39.524823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:39.551254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 14/29] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:39.557416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.675732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f50a0-6547-4656-8119-c4c97d536b26 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:39.734826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b8a5-6245-40b4-a469-bb5cd5512543 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:39.750530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:39.768900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:39.769800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.770080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.770349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.781837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:39.782989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.783509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.783982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.784835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:39.786501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801947-03a8-4884-a01e-37f12201cbee None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:39.794803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:39.802244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:39.803103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:39.803880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:39.805882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:41:39.811340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.833709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 15/31] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:41:39 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:41:39.836890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e427ff-d619-43ea-bf11-ccc33ea7cf8b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:39.837437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e427ff-d619-43ea-bf11-ccc33ea7cf8b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:39.837910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e427ff-d619-43ea-bf11-ccc33ea7cf8b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:39.842930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 16/32] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:39.845277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e427ff-d619-43ea-bf11-ccc33ea7cf8b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:39.945432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.003929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a143c7-1a7a-406d-8552-1659b93f932d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.065588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e427ff-d619-43ea-bf11-ccc33ea7cf8b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.080729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.081359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.081640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.081911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.082603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.084517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:40.119610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.120584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.121117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.122606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.123524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:40.124026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.125656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f626001-4d88-4cce-8724-7da7cc19422c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:40.137109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:40.138768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7d59-b129-42e4-a529-72f2d16ca35e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.139407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7d59-b129-42e4-a529-72f2d16ca35e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.139873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca7d59-b129-42e4-a529-72f2d16ca35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.228285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 17/34] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Oct 14 17:41:39 2022] POST /identity/v3/roles => generated 219 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:40.229524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:40.289944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-69ca7d59-b129-42e4-a529-72f2d16ca35e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:40.291626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69ca7d59-b129-42e4-a529-72f2d16ca35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:40.297967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.365072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530166-e5f5-4d11-ad54-56a5c5bc5e1b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.418327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.419921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.420737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.421500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] PATH_INFO: `/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.426012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] RBAC: Authorizing `identity:get_user(user_id=cf4c2ccaa5c44feca15e4abc0bc69573)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.429346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25916d41-746e-44de-b0f3-9ad61954eab1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:40.434811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:40 2022] GET /identity/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:40.442447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471852d-beda-47f4-8532-03a1eca1ab07 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.442979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471852d-beda-47f4-8532-03a1eca1ab07 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.443838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471852d-beda-47f4-8532-03a1eca1ab07 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.445486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:41:40.446505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471852d-beda-47f4-8532-03a1eca1ab07 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:40.459211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 18/37] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:40.462277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249603dc-e33c-41df-bb61-f273a12d41bb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.462980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249603dc-e33c-41df-bb61-f273a12d41bb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.463590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249603dc-e33c-41df-bb61-f273a12d41bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.488454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-249603dc-e33c-41df-bb61-f273a12d41bb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:40.490517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-249603dc-e33c-41df-bb61-f273a12d41bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:40.529996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.579566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:40.596411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471852d-beda-47f4-8532-03a1eca1ab07 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.633486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.637227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fedda-43d8-4d4b-a20f-8ddfb06e69b5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.637585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fedda-43d8-4d4b-a20f-8ddfb06e69b5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.638024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fedda-43d8-4d4b-a20f-8ddfb06e69b5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.638863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.639532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.639853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.639963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 20/39] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:40.640118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.644033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.645252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.645465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:40.645561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.645797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.647071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:40.654024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:40.666114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:40.667630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:40.774464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:41:40.781600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:40.787010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab20d67-755e-447d-b3fa-876f9b3e8c41 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.824110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.824718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.825023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.825276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.826005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.domain.id=default, user.id=cf4c2ccaa5c44feca15e4abc0bc69573) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:40.826312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.827885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:40.838337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 21/42] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Oct 14 17:41:40 2022] GET /identity/v3/role_assignments?user.id=cf4c2ccaa5c44feca15e4abc0bc69573&scope.domain.id=default&role.id=87f9d55d22b7471e941216189675256a => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:40.875339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:40.904417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.916505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90f210-3f2d-43d9-b66a-243dedb99df1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:40.952891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:40.973265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:40.973895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:40.974172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:40.974436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:40.975124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:40.976547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:41.003494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Oct 14 17:41:40 2022] POST /identity/v3/roles => generated 225 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:41:41.020979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea3c1-3d69-4c1b-90f4-97d32354d91d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:41.061339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:41.062381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:41.062857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:41.063401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:41.064423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:41.066096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:41.073732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:41.091441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Oct 14 17:41:40 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:41:41.208489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2117f-eb38-439d-a39a-a036d01a1b14 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:41.246066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:41.246734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:41.247014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:41.247306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:41.248608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:41.250099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844603a-5cf8-4701-9605-d3bb00c7f054 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:41.252919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:41.258475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:41.362551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820afd39-1556-41ba-95ee-786dd872354b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:41.375059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:41.397139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:41.397743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:41.398028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:41.398303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:41.398951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:41.400444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad29d33-9291-4f97-a54a-9a0e7a435856 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:41.426980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:41:41 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:43.565945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5342b78-1134-4a0b-998d-9f78d0d78edd None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:43.566457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5342b78-1134-4a0b-998d-9f78d0d78edd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:43.566563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5342b78-1134-4a0b-998d-9f78d0d78edd None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:43.567914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:43.573144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:43.573557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:43.573687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:43.592401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:43.593888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:43.657542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:43.928896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5342b78-1134-4a0b-998d-9f78d0d78edd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:43.953909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:44.029749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5342b78-1134-4a0b-998d-9f78d0d78edd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:44.062836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:44.063516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:44.063796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:44.064066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:44.065203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:44.066757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735c85f-b3b9-4481-b0e8-e440ad115af5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:44.068326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:44.073887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:44.162833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:44.170422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7fb4d-0b5e-4ff9-ae7e-f87ef0cc213d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:44.203469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:44.203987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:44.204264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:44.204532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:44.205185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:44.207120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ee2c-196e-4e9c-bb00-0f89cb640453 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:44.232208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Oct 14 17:41:44 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:46.419445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a7b2-98b9-4ada-9685-16e5d2415a64 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:46.419957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a7b2-98b9-4ada-9685-16e5d2415a64 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:46.420039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a7b2-98b9-4ada-9685-16e5d2415a64 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:46.421346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 26/51] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:46.427394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:46.427794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:46.427938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:46.549796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:46.551159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:46.618984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:46.890559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a7b2-98b9-4ada-9685-16e5d2415a64 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:46.978278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:46.989225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a7b2-98b9-4ada-9685-16e5d2415a64 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:47.022349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:47.022961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:47.023238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:47.023530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:47.024615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:47.026043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ce858-70f4-44f6-a7b1-6e3d50623267 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:47.027615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:47.033106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:47.105877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:47.129710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9a53-175d-4212-b137-c87e595d43a4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:47.161978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:47.162564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:47.162838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:47.163105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:47.163785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:47.165215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e975c2-3ba4-4a0e-9569-e16a0f301114 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:47.191181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 27/54] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:41:47 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:50.427460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ce15c-a413-469b-9d12-bb3727e023cb None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.428476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ce15c-a413-469b-9d12-bb3727e023cb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.428947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ce15c-a413-469b-9d12-bb3727e023cb None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.430508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 28/55] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:50.435992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7feb-937f-407b-ab67-9746d970c3fb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.436818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7feb-937f-407b-ab67-9746d970c3fb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.437323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7feb-937f-407b-ab67-9746d970c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.461775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6adc7feb-937f-407b-ab67-9746d970c3fb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:50.463308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6adc7feb-937f-407b-ab67-9746d970c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:50.483431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5832f6-7f58-4aed-aed5-c37be2cd0613 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.484011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5832f6-7f58-4aed-aed5-c37be2cd0613 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.484471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5832f6-7f58-4aed-aed5-c37be2cd0613 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.486030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 29/56] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:41:50.504576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d4e6-3186-47e0-981c-16475b611365 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.505288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d4e6-3186-47e0-981c-16475b611365 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.505778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97d4e6-3186-47e0-981c-16475b611365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.532222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2c97d4e6-3186-47e0-981c-16475b611365 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:50.539027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2c97d4e6-3186-47e0-981c-16475b611365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:50.592166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:50.648664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 14 17:41:50.807474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42947-a72f-4e6d-9e14-c4360c0d37ab None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.807807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42947-a72f-4e6d-9e14-c4360c0d37ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.808033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a42947-a72f-4e6d-9e14-c4360c0d37ab None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.809400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 29/59] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:50.814611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a9ea-3167-43c1-93db-1d4adad0cce1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:50.814895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a9ea-3167-43c1-93db-1d4adad0cce1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:50.815165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a9ea-3167-43c1-93db-1d4adad0cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:50.840244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6e36a9ea-3167-43c1-93db-1d4adad0cce1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:50.841454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6e36a9ea-3167-43c1-93db-1d4adad0cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:50.943452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 31/60] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:50.955490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a42947-a72f-4e6d-9e14-c4360c0d37ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.005794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f5a2-ba9e-4533-87d9-e6828a4acf01 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.006113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f5a2-ba9e-4533-87d9-e6828a4acf01 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.006356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f5a2-ba9e-4533-87d9-e6828a4acf01 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.007898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 32/61] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:51.012685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.012974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.013255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.038857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:51.040075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:51.047343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.072417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.116275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a42947-a72f-4e6d-9e14-c4360c0d37ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.147502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 33/62] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:41:51.148733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.165503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.166539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.168033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.168449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.186723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:51.193968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:51.194953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:51.195806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:51.197649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 30/63] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:51.205820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.280845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446075a-2086-4bf2-91a1-e4d13de441f3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.313746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523abea-2371-4a9f-b57f-d7459eb7d2c5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.317840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.318631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.319050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.319488 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.330846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:51.336198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:51.337026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:41:51.337882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 34/64] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:51.338487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.339495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.351846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.354547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.355154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.355460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.355726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.356451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:51.356746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.358848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744695f-c384-4305-bbde-6b4d7dc8f63c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.372826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 31/65] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.374004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8a95-0e8c-40e1-8fbd-1c174772e38a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.374289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8a95-0e8c-40e1-8fbd-1c174772e38a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.374560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8a95-0e8c-40e1-8fbd-1c174772e38a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.379408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 32/66] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:51.379408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f8a95-0e8c-40e1-8fbd-1c174772e38a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.451519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d49bb-3c8e-445e-aa3e-f004808dde2c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.486185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.486824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.487105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.487402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.491811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f8a95-0e8c-40e1-8fbd-1c174772e38a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.498205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:51.503044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:51.504197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 35/67] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:51.504950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.526960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.527597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.527874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.528145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.528803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:51.529104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.530465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aae9e-1265-402e-b5c1-a07d979cde99 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.538804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 33/68] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.539957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.540244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.540514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.558545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:51.559769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:51.572805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.602117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.606127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2800ce-9c43-4547-98f0-143524f109d0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.626217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:51.627110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.640343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.640974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.641251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.641521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] PATH_INFO: `/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.642658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=cf4c2ccaa5c44feca15e4abc0bc69573)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.644646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.646448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.647047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.744970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3c3d-9e80-4138-bb94-ac1a4a0faf8a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.751826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd19be-48d5-494c-82e7-d361d471f3c7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.779905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.780540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.780819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.781090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.790478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.791604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.791708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:51.792150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.792595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.793505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:51.793995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.795579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:51.796530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:51.797365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:51.798154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:51.799864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.805215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.818117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.818117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.838395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:51.905696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc026-2105-456c-9536-baf0d319dc71 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.924650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7860a-29ff-447e-a381-a8068e3cf9d3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:51.939911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.940543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.940826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.941184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.955691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.957849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.958791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:51.959455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:51.959571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.959743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:51.960021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:51.960248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:51.961414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:51.962866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:51.964992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:51.965757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.029768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.054098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.060849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31da44b-bfca-4cf8-b877-0daae80c47a5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.065088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd8cb-0dc4-437f-9c99-e769c7489bde None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.096497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.097100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.097384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.097785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.098454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:52.098752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.099250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.099898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.100139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.100226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.100431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.101538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.102985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.104577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 39/75] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.105324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.112406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 37/76] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.113446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.205233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693ffa3-946e-4fa3-9171-dc35061b7112 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.212286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfae52-3dfe-44fc-a02f-8708802a264a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.237733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.238607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.238947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.239299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.240416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.241854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.243439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 40/77] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.244238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.246693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.249558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.250193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.250467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.250732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.251878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.253308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.260130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 38/78] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:52 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.260130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.281747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.349576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8d2a4-75a2-447c-855f-664e8a5de47f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.357047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea44d-7483-4dca-9aff-bdd0b992f340 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.382127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.382776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.383054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.383359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/cf4c2ccaa5c44feca15e4abc0bc69573/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.385228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, user_id=cf4c2ccaa5c44feca15e4abc0bc69573, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.386653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.390303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.391031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.391375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.391813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.393326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.395762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.402299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 39/79] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:52 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.402299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.402538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 41/80] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:41:52 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/cf4c2ccaa5c44feca15e4abc0bc69573/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:41:52.402538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.467955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.514134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6b393-6bce-49c3-acaa-5e08b9d7bd75 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.518310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.527991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74aae1-d302-4c1a-b950-e91c95f31df4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.554508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.555075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.555379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.555656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.556332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.557815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.565486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.566495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.566986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.567512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.568873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.570498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.572140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 40/81] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:52 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.572955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.589954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 42/82] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:41:52 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:52.590373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.699417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d9f20-e18e-4afe-8660-c822be3896e9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.740899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.741580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.741678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d134d-1c41-403b-b356-2897a7129e8e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.741865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.742144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.744488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, user_id=1923e5feb96e4ceaba8aea85009a9f4f, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.745977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.764447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.768693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:41:52 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:41:52.772701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:52.807119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.807791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.808127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.808409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.810802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, user_id=1923e5feb96e4ceaba8aea85009a9f4f, role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.811984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:52.813733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.836260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:41:52 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:41:52.923898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347441e0-b667-4b4a-9213-e4d656632c6a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:52.968406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:52.969082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:52.969363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:52.969638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] PATH_INFO: `/v3/projects/9e9df0c50b424de9a3b097c132bafe0b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:52.970881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] RBAC: Authorizing `identity:get_project(project_id=9e9df0c50b424de9a3b097c132bafe0b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:52.972630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcf2e6-6c24-4a12-9a01-5e74e1ce27fe None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:52.974434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 42/85] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:52 2022] GET /identity/v3/projects/9e9df0c50b424de9a3b097c132bafe0b => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:52.980586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:53.098597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dfc58-ed3e-4004-af74-98ba2c0996f9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:53.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:53.135526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:53.135811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:53.136085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] PATH_INFO: `/v3/projects/9e9df0c50b424de9a3b097c132bafe0b/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:53.138041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e9df0c50b424de9a3b097c132bafe0b, user_id=1923e5feb96e4ceaba8aea85009a9f4f, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:53.139591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29ae2-70a1-42f9-afe5-81fa6084d1a8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:53.156902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:41:52 2022] PUT /identity/v3/projects/9e9df0c50b424de9a3b097c132bafe0b/users/1923e5feb96e4ceaba8aea85009a9f4f/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:41:55.171527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53f-f973-447c-a16c-0e764d5610bb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:55.172563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53f-f973-447c-a16c-0e764d5610bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:55.173048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53f-f973-447c-a16c-0e764d5610bb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:55.174597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 43/87] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:55.180321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f2031-5f01-4057-998d-d2f272cf2032 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:55.181107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f2031-5f01-4057-998d-d2f272cf2032 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:55.181578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f2031-5f01-4057-998d-d2f272cf2032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:55.208354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9e3f2031-5f01-4057-998d-d2f272cf2032 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:55.209886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e3f2031-5f01-4057-998d-d2f272cf2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:55.247463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:55.297560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:55.514695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e8b43-6c26-4ead-b584-bf01320ecae5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:55.515397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e8b43-6c26-4ead-b584-bf01320ecae5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:55.515884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e8b43-6c26-4ead-b584-bf01320ecae5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:55.517661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 44/89] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:55.524424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:55.524955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:55.525423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:55.560310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:55.561840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:55.676140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e8b43-6c26-4ead-b584-bf01320ecae5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:55.716285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 46/90] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:41:55.835168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:55.857355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e8b43-6c26-4ead-b584-bf01320ecae5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:55.909297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:55.909989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:55.910245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:55.910516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:55.928480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:55.933343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:55.934173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:55.934924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:55.942139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.197139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:56.202647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dead2-8f02-4a54-85f1-5028567af434 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.247435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.266698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:56.267909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.268391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.268852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.270347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:56.270931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:56.273388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:56.282941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:56.290598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.458847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac5f3-d4ee-4dc2-9853-c30eef0ee517 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.494604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:56.495212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.495520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.495789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.495957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cb5f8-0d72-4013-a2c7-88b82616dea4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.507126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-75d2ce5a-db5d-42fa-839b-c437779f9e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:56.512043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:56.512858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:56.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:56.514441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1452-9cc4-446b-b993-48f56e61799a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.514799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1452-9cc4-446b-b993-48f56e61799a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.515021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca1452-9cc4-446b-b993-48f56e61799a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.516236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 47/94] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:56.520678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8531-424d-4cb8-a2a2-97a84caeb21d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.520968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8531-424d-4cb8-a2a2-97a84caeb21d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.521238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8531-424d-4cb8-a2a2-97a84caeb21d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.524295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 48/95] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:56.525920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35c71-5b8d-4376-9a43-d1dfbed737db None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.526032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35c71-5b8d-4376-9a43-d1dfbed737db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.527630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a35c71-5b8d-4376-9a43-d1dfbed737db None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.527630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 49/96] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:56.532140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a35c71-5b8d-4376-9a43-d1dfbed737db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.539008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:56.539667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.539947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.540222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] PATH_INFO: `/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.541715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] RBAC: Authorizing `identity:get_user(user_id=cf4c2ccaa5c44feca15e4abc0bc69573)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:56.542850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:56.543929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0448226-9739-4f8b-ae9f-03c23399165a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:56.545722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:56 2022] GET /identity/v3/users/cf4c2ccaa5c44feca15e4abc0bc69573 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:56.546687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172239-ce95-4436-8589-7e33d6fcd1f4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.546968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172239-ce95-4436-8589-7e33d6fcd1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.547238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172239-ce95-4436-8589-7e33d6fcd1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.564979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-65172239-ce95-4436-8589-7e33d6fcd1f4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:56.566670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-65172239-ce95-4436-8589-7e33d6fcd1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:56.590654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:56.645286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 49/98] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:56.645286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.645286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.645286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.658930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:56.661769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:56.664072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a35c71-5b8d-4376-9a43-d1dfbed737db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.718613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:56.719689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.719983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.720423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.721262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:56.721571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:56.723835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9e4f-344f-4cde-976a-ebfa6d22859b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:56.735740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 50/99] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:56.738115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.738906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.739897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:56.747014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 50/100] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:56.747897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.760813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:56.761914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:56.836129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:56.842782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:56.848398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:56.858637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:56.885371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b424e9d-4b33-40d5-bc6b-82100bd6b1d3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.961117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e51b25-9a9e-4a1a-b90f-5b23c4d88685 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:56.975551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:56.976496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:56.977026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:56.977510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.003234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.004203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.004647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.005053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.006807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.008962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b83397-ac0b-4418-90a6-ee41de6df347 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.011400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 52/102] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:56 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:57.013321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef944-1742-407a-b659-539928c8206b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.013747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef944-1742-407a-b659-539928c8206b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.014397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ef944-1742-407a-b659-539928c8206b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.015998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 53/103] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:41:57.016816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ef944-1742-407a-b659-539928c8206b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.069320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.071409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.096360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.139174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ef944-1742-407a-b659-539928c8206b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.159468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.173603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 51/104] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:41:57.174431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.180751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.181390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.181676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.181948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.183055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.184557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38426892-24a1-41a9-bac2-271dd5d03b1e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.190191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 54/105] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:57.190191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.190191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.190191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.205637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:41:57.206873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:41:57.271209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 55/106] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:41:57.272056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.278877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d557-4fb0-49bb-aae6-2ac5bef304d3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.316069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.316681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.316965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.317263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.348858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.375985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.388396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627fcf0-0b6e-43b5-8bdd-11b89bdcf3cc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.389196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.391343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.427818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.428454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.428734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.429004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.440217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:57.445290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:57.446104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:41:57.446856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:57.447937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 56/107] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:57.447937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.491658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:41:57.492309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.561878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818673d4-59c6-4f31-893e-93e810e6eb16 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.579250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.588666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.592134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da92e9-3ac5-4fe8-b902-741a7593728b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.597747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.598375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.598648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.598913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.609368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:57.614358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:57.615374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:57.616892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 57/109] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:57.618771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.627224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.627886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.628169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.628965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.630101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.631581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.633213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 53/110] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:57.638166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.719239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ef281-6e46-4f10-bf40-607e5f664a92 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.733430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d750-f39c-4808-9a72-c444360cdc4e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.752377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.752982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.753278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.753687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.754342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.755847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.766374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.766980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.767265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.767569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.768232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:57.768540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.770524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.779448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 54/111] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:57.780242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.781643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 58/112] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:41:57 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:41:57.782482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.800098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.841820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:57.899152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4754d-0fda-4c54-8afe-2df4856afc3e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.912735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8c00a-aa8f-44fc-b63e-10980b42bf4a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:57.937445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.938408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.938831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.939246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.940669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:57.942472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:57.944695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 55/113] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:57.945638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:57.957714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:57.958429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:57.958713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:57.958983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:57.971910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:41:57.977090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:41:57.977951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:41:57.978720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 59/114] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:41:57.979402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.051857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.069541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad250c-3428-436d-8086-20f0dc1515c6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.083702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.088370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f902149-847d-41fe-bfc6-45022f7f8d6b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.108005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.108823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.109237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.109659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.110504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:58.110936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.112769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.121424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 56/115] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.122416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.123999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.124613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.124894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.125168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.126110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=5db85fbc44914b438b5e9789d24d01fb, user.id=cf4c2ccaa5c44feca15e4abc0bc69573) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:58.126214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.127665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.134435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 60/116] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:41:57 2022] GET /identity/v3/role_assignments?user.id=cf4c2ccaa5c44feca15e4abc0bc69573&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.135097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.256397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff674d-cc36-4fe1-851c-a6be9902d48c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.269217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e651ef-c242-4322-88f4-874087052f94 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.295084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.296561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.297055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.297569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.299026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.300855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.302596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 57/117] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.303429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.309798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.310415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.310700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.310975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.311755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] RBAC: Adding query filter params (role.id=fe3e0f43a9894ab9a2c1553312375e0d, scope.project.id=5db85fbc44914b438b5e9789d24d01fb, user.id=1923e5feb96e4ceaba8aea85009a9f4f) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:58.312067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.313599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.321240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 61/118] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/role_assignments?user.id=1923e5feb96e4ceaba8aea85009a9f4f&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.322061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.331770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.356684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.433839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4497c1-8967-4f02-9031-e1b5f58431dd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.470375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0c0c-0e62-4f2a-a128-e75c7739fe54 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.477856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.478486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.478814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.479093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.479956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:58.480272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.481704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.492815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 58/119] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.493759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.515177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.515980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.516265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.516537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] PATH_INFO: `/v3/users/c8026b64afc54872a6faca2bdd542dee` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.536304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] RBAC: Authorizing `identity:get_user(user_id=c8026b64afc54872a6faca2bdd542dee)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.537948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.540747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 62/120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/users/c8026b64afc54872a6faca2bdd542dee => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.541839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.593402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.620904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc77598-66a6-4506-a1c8-dc2674765f46 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.653924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.662073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.662689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.662968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.663229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.672488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d522d-14d8-4105-b232-d3121c9c2f88 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.715466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.715984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.716265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.716632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] PATH_INFO: `/v3/users/1923e5feb96e4ceaba8aea85009a9f4f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.717656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] RBAC: Authorizing `identity:get_user(user_id=1923e5feb96e4ceaba8aea85009a9f4f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.719314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.720708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 63/121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/users/1923e5feb96e4ceaba8aea85009a9f4f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.725928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.742757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.744435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.827815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.838752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585260f2-cd64-46b2-b744-3c23b910338d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.850776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 59/122] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:41:58.851636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.881403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:58.882044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:58.882592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:58.882897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:58.884067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:58.885525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:58.887309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 64/123] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:58.888047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:58.911338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:58.964607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24234255-dcc1-46a5-a2bc-ff2a14e76bf8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:58.991959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372e705-7bb1-458d-89f1-183c2d8530af None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:59.002223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.002849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.003110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.004059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.027270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.027940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.028523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.028812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.030365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.031869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.039311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 65/124] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:59.039311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:59.056799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:59.081440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.082902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.133423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:59.147761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444047-0267-4a69-82ee-af1b36dbe5bd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:59.182803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.183488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.183773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.184054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/c8026b64afc54872a6faca2bdd542dee/roles/55eba99938a248729a99f8898b46461d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.185981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, user_id=c8026b64afc54872a6faca2bdd542dee, role_id=55eba99938a248729a99f8898b46461d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.187505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.194554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:41:59.196734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:59.201531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 66/126] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:41:59 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/users/c8026b64afc54872a6faca2bdd542dee/roles/55eba99938a248729a99f8898b46461d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:41:59.202400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:59.307642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:41:59.341447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeb8e-cb30-4b57-8528-fbc09c1b264b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:59.346912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e51f87-e4ef-405f-884f-be36b1a3fcbc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:59.382392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.383009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.383420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.383701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.384456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] RBAC: Adding query filter params (role.id=f2bf712db5ff4496beaf17fbf5cb2418, scope.project.id=5db85fbc44914b438b5e9789d24d01fb, user.id=1923e5feb96e4ceaba8aea85009a9f4f) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:59.384848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.386354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.390374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.391071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.391335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.391618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] PATH_INFO: `/v3/projects/9e9df0c50b424de9a3b097c132bafe0b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.393597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] RBAC: Authorizing `identity:get_project(project_id=9e9df0c50b424de9a3b097c132bafe0b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.395384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 61/127] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:41:59 2022] GET /identity/v3/role_assignments?user.id=1923e5feb96e4ceaba8aea85009a9f4f&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=f2bf712db5ff4496beaf17fbf5cb2418 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:59.395617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7589c0-70c6-43f2-a844-2fbd60dd1417 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.397449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 67/128] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:41:59 2022] GET /identity/v3/projects/9e9df0c50b424de9a3b097c132bafe0b => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:41:59.403856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:41:59.525667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d609c-addd-4781-89d2-a506500ef7cd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:41:59.567941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:41:59.568813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:41:59.569238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:41:59.569649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:41:59.570603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] RBAC: Adding query filter params (role.id=fe3e0f43a9894ab9a2c1553312375e0d, scope.project.id=9e9df0c50b424de9a3b097c132bafe0b, user.id=1923e5feb96e4ceaba8aea85009a9f4f) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:41:59.571154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:41:59.572859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff903-19cd-4c97-bfa8-72893a8723cd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:41:59.579913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 62/129] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:41:59 2022] GET /identity/v3/role_assignments?user.id=1923e5feb96e4ceaba8aea85009a9f4f&scope.project.id=9e9df0c50b424de9a3b097c132bafe0b&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:00.062498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524388-4f7a-4fcf-af50-b4bd63cfe1c4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:00.062838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524388-4f7a-4fcf-af50-b4bd63cfe1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:00.063117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524388-4f7a-4fcf-af50-b4bd63cfe1c4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:00.064496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 68/130] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:00.069653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:00.070010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:00.070350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:00.083577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:00.089353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:00.090530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:00.157973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 63/131] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:00.423818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524388-4f7a-4fcf-af50-b4bd63cfe1c4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:00.442626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:00.526534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524388-4f7a-4fcf-af50-b4bd63cfe1c4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:00.559983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:00.560612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:00.560894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:00.561166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:00.562266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:00.563739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19db2d-5647-4bc0-a863-28122d96b779 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:00.565301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 69/132] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:00.571422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:00.670061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46a259-857f-44e3-8893-9c7af7679488 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:00.709253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:00.709868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:00.710148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:00.710420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:00.711347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:00.712780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7403-3116-4913-8047-effa39269936 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:00.721602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:00.734235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 64/133] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:00 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:01.433233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a326-02ad-440a-bb9a-4210750a6bba None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:01.433734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a326-02ad-440a-bb9a-4210750a6bba None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:01.433805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254a326-02ad-440a-bb9a-4210750a6bba None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:01.435135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 70/134] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:01.440441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:01.441290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:01.441584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:01.460390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:01.461835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:01.529984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:01.805240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a326-02ad-440a-bb9a-4210750a6bba None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:01.899222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:01.926271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254a326-02ad-440a-bb9a-4210750a6bba None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:01.961786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:01.962602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:01.963034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:01.963469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:01.974407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:01.979370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:01.980399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:01.981366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:01.983188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 71/136] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:01.991819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:02.087269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798fdf-5285-4044-9c04-2c6aa6fa8039 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:02.110560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:02.124124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:02.124750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:02.125047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:02.125317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:02.126040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:02.126346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:02.127825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:02.136303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 66/137] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:02.142043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:02.247436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a1e8-5bbf-41db-b2eb-4b8ca7bc8999 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:02.284405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:02.286039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:02.286520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:02.286973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] PATH_INFO: `/v3/users/c8026b64afc54872a6faca2bdd542dee` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:02.288433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] RBAC: Authorizing `identity:get_user(user_id=c8026b64afc54872a6faca2bdd542dee)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:02.290058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:02.292155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 72/138] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:02 2022] GET /identity/v3/users/c8026b64afc54872a6faca2bdd542dee => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:02.297849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:02.401011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db8c0f-d64d-4340-b501-e4b92f350f77 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:02.435355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:02.436278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:02.436745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:02.437214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:02.489779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:02.506327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:02.508099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:02.611381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:02.617643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:02.633794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:02.728223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd57b18-3d32-455c-ab6c-445bdde73f92 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:02.764004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:02.764565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:02.764838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:02.765110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:02.766245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:02.767718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ca693-bcab-4b06-a893-79721c2dfe3d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:02.770065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 73/140] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:02 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:02.775748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:02.865065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:02.881925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246c28-7a7b-4844-9ef7-d2ed04137fa9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:02.917570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:02.918177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:02.918457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:02.918774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:02.919629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] RBAC: Adding query filter params (role.id=55eba99938a248729a99f8898b46461d, scope.project.id=5db85fbc44914b438b5e9789d24d01fb, user.id=c8026b64afc54872a6faca2bdd542dee) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:02.919944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:02.921368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327dd01-4e05-4c07-9cfc-fa6f3cfe503e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:02.927657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 68/141] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:02 2022] GET /identity/v3/role_assignments?user.id=c8026b64afc54872a6faca2bdd542dee&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=55eba99938a248729a99f8898b46461d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:03.132262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3372-cea9-4923-b107-0e4886e55ac3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.132643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3372-cea9-4923-b107-0e4886e55ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.132847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc3372-cea9-4923-b107-0e4886e55ac3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.134401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:03.140114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296fb1-3159-4cfb-af87-3482018ae533 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.140725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296fb1-3159-4cfb-af87-3482018ae533 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.140725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296fb1-3159-4cfb-af87-3482018ae533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.160766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-74296fb1-3159-4cfb-af87-3482018ae533 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:03.161968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-74296fb1-3159-4cfb-af87-3482018ae533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:03.239837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:03.242336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10a3a-eb08-4b3f-b3c7-a79b47eb1b47 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.242696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10a3a-eb08-4b3f-b3c7-a79b47eb1b47 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.243044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10a3a-eb08-4b3f-b3c7-a79b47eb1b47 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.244590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 75/144] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:03.249426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.250029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.250498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.270195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:03.271414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:03.311327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4543-cb7b-4e05-b1e8-459569de9a0c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.311638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4543-cb7b-4e05-b1e8-459569de9a0c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.311873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4543-cb7b-4e05-b1e8-459569de9a0c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.313339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 76/145] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:03.318874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.319147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.319448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.338311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:03.339543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:03.341281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 70/146] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:03.407473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 77/147] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:03.511694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.522969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:03.613250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.613866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b5b0c-0f33-4cc9-96cd-4a2dc4ff12f6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:03.625422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:03.650696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:03.651355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.651636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.651906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.663026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:03.667804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:03.668633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:03.669396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 71/148] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:03.674573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.727791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694e506-c06b-48df-af10-b7d0ce74847d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:03.740534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:03.761148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:03.761808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.762090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.762356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.772732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:03.773118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bf96-f63c-4361-938f-a767dce2113c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:03.777475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:03.778382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:03.779151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 78/149] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:03.779829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.807801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:03.808414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.808698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.808971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.809637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:03.809943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:03.811366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:03.824875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 72/150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:03.824875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.850549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:03.882430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf8ac-e307-4738-87cc-5f63c3530f92 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:03.915904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:03.916465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.916749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.917009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.918179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:03.919582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:03.920197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a33ab-4554-45dd-8016-4d449212d0f7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:03.921147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 79/151] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:03.921904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:03.952679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:03.959405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:03.960017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:03.960299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:03.960570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:03.961484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:03.961786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:03.963156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:03.971027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 73/152] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:03.971027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.030451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd661a88-0fc0-47a7-9f7c-70623a3ca3c8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.063397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.064023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.064300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.064566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] PATH_INFO: `/v3/users/aa3eb94617924b6ca9497bbc8ef59546` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.067785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a672-2592-4270-b425-4af155f98d79 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.072783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:04.078874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] RBAC: Authorizing `identity:get_user(user_id=aa3eb94617924b6ca9497bbc8ef59546)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.080371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.082251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 80/153] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:03 2022] GET /identity/v3/users/aa3eb94617924b6ca9497bbc8ef59546 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:04.087760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.101245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.101853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.102134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.102403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.103045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.104574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.125978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 74/154] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:03 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:04.126786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.187133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:04.203758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7325f-2066-4c1f-884e-e8f47e4969c3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.245788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.246454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.246701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.246965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] PATH_INFO: `/v3/users/aa3eb94617924b6ca9497bbc8ef59546` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.248181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] RBAC: Authorizing `identity:get_user(user_id=aa3eb94617924b6ca9497bbc8ef59546)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.249678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.250911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ccf4c-4c83-46f8-8717-7db0a1a6564a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.251369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 81/155] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:04 2022] GET /identity/v3/users/aa3eb94617924b6ca9497bbc8ef59546 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:04.257188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.294198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.294834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.295108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.295405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.296538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.297998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.299841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 75/156] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:04 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:04.306041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.329297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:04.374542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380a983-7d8f-47ef-8f33-b78d974d8795 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.419561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.420473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.420751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.421023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.422263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.423752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.426237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 82/157] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:04 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:04.431950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fddd1-5ce2-40a3-8f36-05f95281ef0e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.432810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:04.448843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:04.469936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.470683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.471023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.471408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/aa3eb94617924b6ca9497bbc8ef59546/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.475131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, user_id=aa3eb94617924b6ca9497bbc8ef59546, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.477706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cefa40-3d19-4bd7-9d39-f5cdae3aaf6c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.497587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 76/158] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:04 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/aa3eb94617924b6ca9497bbc8ef59546/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:42:04.556462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e0b7-b6cf-493e-b2dc-8fe57e01e0cd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:04.591164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:04.596923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:04.598128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:04.598415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:04.598945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/aa3eb94617924b6ca9497bbc8ef59546/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:04.601676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, user_id=aa3eb94617924b6ca9497bbc8ef59546, role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:04.603140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce13df1-3b1f-4c33-b670-881f38085721 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:04.617919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 83/159] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:04 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/aa3eb94617924b6ca9497bbc8ef59546/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:42:06.444357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3b4d-372b-4500-bc7e-86b4929b0853 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.444993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3b4d-372b-4500-bc7e-86b4929b0853 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.444993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c3b4d-372b-4500-bc7e-86b4929b0853 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.446388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 77/160] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:06.451492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb441-9a85-406f-ad7b-34452bddf3c7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.451925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb441-9a85-406f-ad7b-34452bddf3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.452023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb441-9a85-406f-ad7b-34452bddf3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.471442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fffdb441-9a85-406f-ad7b-34452bddf3c7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:06.472798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fffdb441-9a85-406f-ad7b-34452bddf3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:06.529644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd38e-4f26-4ab9-8291-5eee6680ba61 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.529958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd38e-4f26-4ab9-8291-5eee6680ba61 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.530180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edd38e-4f26-4ab9-8291-5eee6680ba61 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.531791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 78/161] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:06.537790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cb34c-2445-4480-b0ba-f7ca2625fb2e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.538070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cb34c-2445-4480-b0ba-f7ca2625fb2e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.538401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cb34c-2445-4480-b0ba-f7ca2625fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.546667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 84/162] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:06.557275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d42cb34c-2445-4480-b0ba-f7ca2625fb2e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:06.558526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d42cb34c-2445-4480-b0ba-f7ca2625fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:06.632081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 79/163] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:06.725534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fe25-1324-45cf-88ef-55b5400fe8c2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.725827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fe25-1324-45cf-88ef-55b5400fe8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.725999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fe25-1324-45cf-88ef-55b5400fe8c2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.727465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 85/164] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:06.732740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5476a6-e7e5-4f1e-b218-15584ad510fa None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.733026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5476a6-e7e5-4f1e-b218-15584ad510fa None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.733298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5476a6-e7e5-4f1e-b218-15584ad510fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.753322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e5476a6-e7e5-4f1e-b218-15584ad510fa None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:06.754926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e5476a6-e7e5-4f1e-b218-15584ad510fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:06.826215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 80/165] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:06.845916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61fe25-1324-45cf-88ef-55b5400fe8c2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:06.870073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb538-d454-4b11-a724-83352b831523 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.870356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb538-d454-4b11-a724-83352b831523 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.871234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb538-d454-4b11-a724-83352b831523 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.873085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 81/166] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:06.878615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84697-d127-4133-91b2-0685b860caca None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:06.879429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84697-d127-4133-91b2-0685b860caca None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:06.879934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84697-d127-4133-91b2-0685b860caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:06.898043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-24b84697-d127-4133-91b2-0685b860caca None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:06.899565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-24b84697-d127-4133-91b2-0685b860caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:06.929633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:06.967504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61fe25-1324-45cf-88ef-55b5400fe8c2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:06.969150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 82/167] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:06.970073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84697-d127-4133-91b2-0685b860caca None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:06.994258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.008803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.009569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.009900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.010277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.021117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:07.025993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:07.026941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:07.027788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 86/168] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:07.033337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.097487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84697-d127-4133-91b2-0685b860caca None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.132511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.133140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.133419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.133685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.134795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.136282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.137849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 83/169] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.137849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.148094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506460-5c6e-4229-bfc5-18886b327ed0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.172282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.187291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.187985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.188266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.188530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.189198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:07.189499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.191474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.200487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 87/170] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:07.206836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.245746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eae1f-af65-46d8-8fd3-f96f78fc957c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.255966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.279817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.280457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.280731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.281002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.290978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:07.296241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:07.297220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:07.298169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 84/171] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:07.302218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.311164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531f3d-cbc1-4c00-948d-b719874e0cf3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.345448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.346046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.346320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.346583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.347268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.348709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.374621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 88/172] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:07 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:07.374621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.414196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.423489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471c5e-2e7c-40a5-b5db-e19afaccf2be None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.462009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.462694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.462922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.463191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] PATH_INFO: `/v3/users/2dcfe26616634089b9b1ce3f87cb0da1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.478536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=2dcfe26616634089b9b1ce3f87cb0da1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.480170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.481995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 85/173] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/users/2dcfe26616634089b9b1ce3f87cb0da1 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.482665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.509944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.513855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac12dc8-5918-478b-836c-6d1b12b8a8d0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.552026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.552668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.552946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.553209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.565274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:07.570707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:07.571667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:07.572482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 89/174] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:07.573249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.608356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291c05-f2e8-4f36-92f7-8d490b538eb4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.648387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.649009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.649287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.649552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.650222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:07.650522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.652038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.662027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 86/175] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.663211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.688922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.697378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfeb65-996e-4ae1-a797-333a69ce3701 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.743965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.744608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.744882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.745148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.746449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.747785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.749573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 90/176] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.750697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.785743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.797819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e2f44-f98b-4411-8cfb-a899a78048e0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.843860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.844475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.844753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.845022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.845693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:07.845993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.847431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.858526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 87/177] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.863733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.882364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc26eb8-608a-4d92-ab0c-0c90466bd2ec None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:07.917921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:07.918563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:07.918841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:07.919153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] PATH_INFO: `/v3/users/aa3eb94617924b6ca9497bbc8ef59546` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:07.920339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] RBAC: Authorizing `identity:get_user(user_id=aa3eb94617924b6ca9497bbc8ef59546)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:07.921834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:07.923512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 91/178] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/users/aa3eb94617924b6ca9497bbc8ef59546 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:07.924354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:07.953943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:07.982174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5622e6-8776-4ce2-9321-f6d2c97907b1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.020832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.021839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.022430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.022995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/2dcfe26616634089b9b1ce3f87cb0da1/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.026358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, user_id=2dcfe26616634089b9b1ce3f87cb0da1, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.028046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.028225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.037864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51703e-5c62-4e3a-be07-5e433ced3240 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.045335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 88/179] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:07 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/2dcfe26616634089b9b1ce3f87cb0da1/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:08.047237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:08.117506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.118550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.119509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.120786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] PATH_INFO: `/v3/users/aa3eb94617924b6ca9497bbc8ef59546` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.122508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] RBAC: Authorizing `identity:get_user(user_id=aa3eb94617924b6ca9497bbc8ef59546)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.125176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.130177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 92/180] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:07 2022] GET /identity/v3/users/aa3eb94617924b6ca9497bbc8ef59546 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:08.141077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:08.257578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c4008-1d3d-457a-ba33-8d4f1a66e412 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.304794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.305340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.305623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.305893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.310232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.333889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ef764-f82a-4280-bd6c-e2dd79644612 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.392701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.394387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.419176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.420243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.420720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.421203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.508702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:08.514309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:08.516181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.579828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.629928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349db39-a994-4262-b414-ddc88b108a77 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.666252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.667114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.667589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.667995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.668117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.669372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.669649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.671116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.673571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 90/182] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:08 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:08.684652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:08.857107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 93/183] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:08.862803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:08.883548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc377-70da-44e2-a699-1d85a246eeba None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:08.891024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.950079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:08.950708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:08.950972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:08.951240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:08.951998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=8ac77a05ae56446faea85b25b3b97a40, user.id=aa3eb94617924b6ca9497bbc8ef59546) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:08.952305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:08.953856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:08.961673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:08.971308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 91/184] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:08 2022] GET /identity/v3/role_assignments?user.id=aa3eb94617924b6ca9497bbc8ef59546&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:09.027848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a2ab-5791-4584-9f9c-d2852c1c0cca None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:09.084628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:09.085981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.086519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.087013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.091511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:09.093285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b6917-60a7-4a86-83d8-a008038895ac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:09.095383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 94/185] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:08 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:09.101660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:09.235384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173a300-a3ba-4571-adfa-e09d013fbb1e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:09.272556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:09.273170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.273452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.273719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.274450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] RBAC: Adding query filter params (role.id=f2bf712db5ff4496beaf17fbf5cb2418, scope.project.id=8ac77a05ae56446faea85b25b3b97a40, user.id=aa3eb94617924b6ca9497bbc8ef59546) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:09.274752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:09.276218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204ca8e-57fe-4bf4-b6ff-96c3120794aa None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:09.282748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 92/186] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:09 2022] GET /identity/v3/role_assignments?user.id=aa3eb94617924b6ca9497bbc8ef59546&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=f2bf712db5ff4496beaf17fbf5cb2418 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:09.910706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc337ef-934e-4ce7-b196-a8eee75d1e5c None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.911208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc337ef-934e-4ce7-b196-a8eee75d1e5c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.911208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc337ef-934e-4ce7-b196-a8eee75d1e5c None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.912637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 95/187] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:09.918001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.918418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.918598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.936449 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:09.937623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:09.942033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57627-099f-4fec-b97b-5e43a260af7d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.942356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57627-099f-4fec-b97b-5e43a260af7d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.942624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57627-099f-4fec-b97b-5e43a260af7d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.944060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 96/188] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:09.948904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:09.949185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:09.949454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:09.966808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:09.969274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:09.970616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:10.017213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 93/189] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:10.040326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 97/190] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:10.288667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.306605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.369507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:10.402548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5451-cf55-4840-bd18-ac561c7d4b7e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.411294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15acb-0ce3-49f4-a81d-693e77e0732c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.442755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.443432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.443705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.443966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.445103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:10.446687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:10.448466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 94/191] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:10.453552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.453684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.454235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.454510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.454773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.468108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:10.474291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:10.475158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:10.475970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 98/192] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:10.481124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.488466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:10.559907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42466729-c8f5-48e1-b24d-adda85313104 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.585469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752ee65-dc30-4eb9-89d8-b97b06c907ba None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.592443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.593040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.593310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.593575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.594213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:10.595670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62d5b-00f8-4c90-b535-03a16250f61e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:10.608249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:10.616905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 95/193] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:10 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:42:10.618403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5977-cb2f-413e-be1f-f4bfd2fa62c3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.618686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5977-cb2f-413e-be1f-f4bfd2fa62c3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.619093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa5977-cb2f-413e-be1f-f4bfd2fa62c3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.623367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 96/194] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:10.623535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.623535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.623535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.623535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.623816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:10.623816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:10.624468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:10.626046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.626327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.626595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.641342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 99/195] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:10.643189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.648909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:10.650109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:10.732013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 97/196] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:10.779777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2b8c1-2b64-4779-ae72-7686eabd36f9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.817156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.818024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.818310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.818584 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] PATH_INFO: `/v3/users/392ade5a677b41408ce83035387c8df0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.832813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] RBAC: Authorizing `identity:get_user(user_id=392ade5a677b41408ce83035387c8df0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:10.834292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:10.836436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 100/197] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:10 2022] GET /identity/v3/users/392ade5a677b41408ce83035387c8df0 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:10.841743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:10.862765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:10.953857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e3e0-ab1a-4df9-ad28-a56b09eeeaad None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:10.992086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:10.992726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:10.993002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:10.993272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:10.994388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:10.995867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:10.997815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 98/198] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:10 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:11.003922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.012155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.060309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:11.115302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:11.134603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ecc69-1ffe-4468-8b80-8c6b488184a9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:11.136821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154b335-dca7-42f6-8960-6332f68e50d7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:11.172596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:11.173728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:11.174141 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:11.174573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/392ade5a677b41408ce83035387c8df0/roles/55eba99938a248729a99f8898b46461d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:11.177557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, user_id=392ade5a677b41408ce83035387c8df0, role_id=55eba99938a248729a99f8898b46461d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:11.179266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:11.179615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:11.179921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:11.180198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:11.180469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:11.193018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:11.196778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:11 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/users/392ade5a677b41408ce83035387c8df0/roles/55eba99938a248729a99f8898b46461d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:11.200114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:11.203024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:11.204064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 99/200] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:11.206156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.324123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2553a03-5b3c-452f-ad04-1487bbd8ab10 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:11.326023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:11.372646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:11.373180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:11.373500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:11.373775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:11.374440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:11.374787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:11.376243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:11.386290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:11.392180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.502506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c157-e65f-4892-80cf-5a4a5553b1b9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:11.539827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:11.540460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:11.540735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:11.541057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] PATH_INFO: `/v3/users/2dcfe26616634089b9b1ce3f87cb0da1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:11.542239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=2dcfe26616634089b9b1ce3f87cb0da1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:11.543730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:11.545317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 100/202] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:11 2022] GET /identity/v3/users/2dcfe26616634089b9b1ce3f87cb0da1 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:11.551423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.654887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708be13-8873-4b6a-99f6-97b64d5976eb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:11.698861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:11.699897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:11.700408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:11.700873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:11.735609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:11.776020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:11.777527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:11.877119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 103/203] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:11.883504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:11.899071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:11.987065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cad1ed-042b-4916-a918-ab320c16b0e1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:12.022272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:12.022898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:12.023168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:12.023461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:12.024582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:12.026025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb646-406b-4fca-b97a-a4797830c78f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:12.027841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 101/204] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:11 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:12.033678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:12.100237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:12.140342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7031d-4e94-42b9-84ce-8f44f4b89620 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:12.174336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:12.175561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:12.175840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:12.176108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:12.176830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] RBAC: Adding query filter params (role.id=fe3e0f43a9894ab9a2c1553312375e0d, scope.project.id=8ac77a05ae56446faea85b25b3b97a40, user.id=2dcfe26616634089b9b1ce3f87cb0da1) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:12.177132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:12.178543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226991-2f0e-46da-80e2-a31209028e72 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:12.191710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 104/205] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:12 2022] GET /identity/v3/role_assignments?user.id=2dcfe26616634089b9b1ce3f87cb0da1&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:13.030649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4a13-732a-4b7b-9dbc-350b89c5a9c5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.031175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4a13-732a-4b7b-9dbc-350b89c5a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.031175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4a13-732a-4b7b-9dbc-350b89c5a9c5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.032578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 102/206] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:13.038066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.038482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.038649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.056708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:13.057869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:13.115732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415e5e-4cb3-4840-bfe3-547551509f4b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.116012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415e5e-4cb3-4840-bfe3-547551509f4b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.116275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4415e5e-4cb3-4840-bfe3-547551509f4b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.117752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 103/207] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:13.122490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.122768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.123033 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.128621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 105/208] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:13.144088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:13.145483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:13.214190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:13.408811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.470600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:13.492185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.504482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:13.517083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41419f48-fb02-4688-b99a-1ca55e59f50e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:13.552526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:13.553157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.553434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.553707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.563589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a105e95d-1ce6-49b2-ad34-44954bf3f079 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:13.568384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:13.569245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 106/210] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:13.572344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad326d-d49e-4c30-928e-55fa1073ce60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.573056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad326d-d49e-4c30-928e-55fa1073ce60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.573056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad326d-d49e-4c30-928e-55fa1073ce60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.573181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 107/211] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:13.575487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad326d-d49e-4c30-928e-55fa1073ce60 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.595968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaae95d-729a-478f-8066-4d8a06ae6289 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:13.629826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:13.630463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.630738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.631007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.632145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:13.633586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4102d-2b12-482d-97f4-2cad7e5f0c61 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:13.635363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 105/212] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:13.636265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.636542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.636827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.654522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:13.655724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:13.681953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad326d-d49e-4c30-928e-55fa1073ce60 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:13.699360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:13.717235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:13.717828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.718099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.718363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.719032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:13.719327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:13.720711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:13.728313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 106/213] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:13.734885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 108/214] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:13.734986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.735070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.748362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:13.842730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f0cf-1df5-4db3-8a80-f6990bcfef29 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:13.843429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c29106-1377-4d39-979d-e4a2ca7d48d3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:13.879189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:13.879830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.880140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.880358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.880997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:13.881238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:13.881868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:13.882150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:13.882421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] PATH_INFO: `/v3/users/d6310780ef1e42dea31bb53be79508a1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:13.882517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:13.896884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] RBAC: Authorizing `identity:get_user(user_id=d6310780ef1e42dea31bb53be79508a1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:13.898467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:13.900213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 109/215] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/users/d6310780ef1e42dea31bb53be79508a1 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:13.905876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:13.906681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 107/216] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:13 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:13.951093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:14.000046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:14.021818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dab8ec-1d32-4f76-b228-c34695089962 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:14.062291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:14.062946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:14.063375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:14.063713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:14.064846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] RBAC: Adding query filter params (role.id=fe3e0f43a9894ab9a2c1553312375e0d, user.id=d6310780ef1e42dea31bb53be79508a1, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:14.065223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:14.067045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:14.073373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:14.073962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 110/217] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/role_assignments?user.id=d6310780ef1e42dea31bb53be79508a1&scope.system=all&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:14.121284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2826-1627-45b8-ad6a-f91ec4087038 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:14.161737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:14.162390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:14.162654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:14.162914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:14.175392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:14.180325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:14.181223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:14.182024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 108/218] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:14.187774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:14.304565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966d56c-65a1-4277-9bae-1b416d797acf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:14.306224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:14.342518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:14.343145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:14.343433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:14.343699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:14.344359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:14.344655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:14.346030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:14.356166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 111/219] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:14.362289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:14.468892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac167-8595-4d14-af66-666e5d9218b0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:14.495261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:14.506132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:14.507218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:14.507523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:14.507790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] PATH_INFO: `/v3/users/392ade5a677b41408ce83035387c8df0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:14.508980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] RBAC: Authorizing `identity:get_user(user_id=392ade5a677b41408ce83035387c8df0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:14.510511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:14.512539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 109/220] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:14 2022] GET /identity/v3/users/392ade5a677b41408ce83035387c8df0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:14.517989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:14.631439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d41151-29aa-499d-8fcb-9581f8975bc1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:14.670025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:14.670632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:14.670908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:14.671176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:14.709658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:14.756110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:14.757630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:14.863896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 112/221] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:14.872379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:14.980620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174606-e37c-471e-af28-8a505d19ff48 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:15.018017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:15.019220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:15.019523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:15.019841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:15.020978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:15.022405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d420e0-973e-48c6-8777-35ef9bcee835 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:15.024226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 110/222] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:14 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:15.032360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:15.097622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:15.139225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccd6e2-bcb0-48f0-b234-357a52a4697d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:15.174512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:15.175479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:15.176088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:15.176547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:15.177511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] RBAC: Adding query filter params (role.id=55eba99938a248729a99f8898b46461d, scope.project.id=8ac77a05ae56446faea85b25b3b97a40, user.id=392ade5a677b41408ce83035387c8df0) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:15.178027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:15.179757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b835c-ca13-4e86-b8e1-71c25fccfd24 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:15.186072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 113/223] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:15 2022] GET /identity/v3/role_assignments?user.id=392ade5a677b41408ce83035387c8df0&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=55eba99938a248729a99f8898b46461d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:16.224825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7eb27-ada9-4a91-9ce0-ddd53c131c72 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.225385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7eb27-ada9-4a91-9ce0-ddd53c131c72 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.225385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7eb27-ada9-4a91-9ce0-ddd53c131c72 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.226736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 111/224] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:16.232786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3af64-db23-4ce5-9c29-68d111179076 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.233293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3af64-db23-4ce5-9c29-68d111179076 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.233293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3af64-db23-4ce5-9c29-68d111179076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.252982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bca3af64-db23-4ce5-9c29-68d111179076 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:16.254188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bca3af64-db23-4ce5-9c29-68d111179076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:16.326196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 114/225] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:16.356540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd1f5-210e-4c94-abc5-d334a9b168bb None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.356819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd1f5-210e-4c94-abc5-d334a9b168bb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.357081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd1f5-210e-4c94-abc5-d334a9b168bb None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.358433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 112/226] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:16.364554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.364841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.365113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.383376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:16.384561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:16.427210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e7d7-5372-43a7-83e9-c937a738edd4 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.427526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e7d7-5372-43a7-83e9-c937a738edd4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.427989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e7d7-5372-43a7-83e9-c937a738edd4 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.429567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 113/227] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:16.434573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.435069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.435570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.438653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:16.453721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 115/228] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:16.455325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:16.457251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:16.513770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:16.526634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 114/229] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:16.595692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:16.700415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c52be-dead-4bc4-9d7f-2460e10f4981 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:16.736514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:16.737192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.737500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.737766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.741962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:16.748705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:16.754331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:16.755442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:16.756235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 116/230] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:16.761320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:16.815610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:16.846298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2790cc-0963-49ee-875b-cd776412d8d8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:16.867889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7f22-e225-4dd0-9964-7146ab136763 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:16.880908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:16.881535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.881811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.882076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.891876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:16.896690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:16.897540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:16.898332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 115/231] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:16.899016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:16.902828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:16.903469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:16.903747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:16.904020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:16.904687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:16.904991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:16.906367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:16.915188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 117/232] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:16.916017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:16.955364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:17.004964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68c49-3cb4-43fb-a8d9-0baf21cc26c9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.016482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6205cc-c1ae-4676-9cf2-9250fadb1899 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.027337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:17.039001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.039656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.039945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.040208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.041305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.042760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.044358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 116/233] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:17.044358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:17.054524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.055122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.055433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.055702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.056361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:17.056665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.058010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.066703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 118/234] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:17.068836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:17.145141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1098-96ec-4720-a250-1ba5062d4cdb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.161530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:17.166626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e8cb-58b8-4c8e-96fb-e7c57504d67f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.179165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.179813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.180084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.180347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] PATH_INFO: `/v3/users/d6310780ef1e42dea31bb53be79508a1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.181448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d6310780ef1e42dea31bb53be79508a1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.182866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.184480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 117/235] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:17 2022] GET /identity/v3/users/d6310780ef1e42dea31bb53be79508a1 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:17.184480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:17.200721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.201379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.201655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.201921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] PATH_INFO: `/v3/groups` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.202542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.203975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.219616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 119/236] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Oct 14 17:42:17 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:17.220376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:17.254509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:17.321994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0893-555a-408e-b290-913e2a18b6f5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.334894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0984cd4-8596-493b-a97d-8eda8582d6b0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.357879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.358527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.358870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.359178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] PATH_INFO: `/v3/users/7a4ec40421a84056ada0264f54866b97` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.376067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4ec40421a84056ada0264f54866b97)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.376507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.377397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.377548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.378636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.379077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] PATH_INFO: `/v3/system/users/d6310780ef1e42dea31bb53be79508a1/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.379979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 118/237] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:17 2022] GET /identity/v3/users/7a4ec40421a84056ada0264f54866b97 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:17.385881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6310780ef1e42dea31bb53be79508a1, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.386051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:17.387331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827bef9-df2d-4a36-b99b-96f85a265827 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.398512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Oct 14 17:42:17 2022] PUT /identity/v3/system/users/d6310780ef1e42dea31bb53be79508a1/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:17.442923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:17.507265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcc733-8469-47d2-bfda-dda78f2bd3c1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:17.545857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:17.546537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:17.546930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:17.547200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:17.548080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] RBAC: Adding query filter params (role.id=55eba99938a248729a99f8898b46461d, user.id=7a4ec40421a84056ada0264f54866b97, scope.system=all) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:17.548427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:17.550752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c92ed-b6f0-4c6a-bd92-a367d904b09c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:17.563330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 119/239] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Oct 14 17:42:17 2022] GET /identity/v3/role_assignments?user.id=7a4ec40421a84056ada0264f54866b97&scope.system=all&role.id=55eba99938a248729a99f8898b46461d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:19.480447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b79c3-b9a0-4556-819e-ca9aae393fb3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.480962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b79c3-b9a0-4556-819e-ca9aae393fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.481066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b79c3-b9a0-4556-819e-ca9aae393fb3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.482492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 121/240] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:19.489388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f519f-6852-464a-a86a-582f56fcb48c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.489922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f519f-6852-464a-a86a-582f56fcb48c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.489922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f519f-6852-464a-a86a-582f56fcb48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.509266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-431f519f-6852-464a-a86a-582f56fcb48c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:19.510449 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-431f519f-6852-464a-a86a-582f56fcb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:19.586615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 120/241] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:19.700939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e3ea-5a35-4f5c-9da1-fb65411dc58a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.701247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e3ea-5a35-4f5c-9da1-fb65411dc58a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.701475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e3ea-5a35-4f5c-9da1-fb65411dc58a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.702952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 122/242] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:19.708398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.708684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.708951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.728504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:19.729827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:19.762452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:19.786612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae94e-c2a6-4431-82a3-9ded65f39e98 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.786909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae94e-c2a6-4431-82a3-9ded65f39e98 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.787212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae94e-c2a6-4431-82a3-9ded65f39e98 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.788748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 123/243] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:19.793652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.793941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.794214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.814874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 121/244] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:19.815075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:19.815075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:19.858077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:19.884258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 124/245] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:19.959584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ab4f0-88ae-4c03-9859-aee4b29b8545 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:19.992847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:19.993478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:19.993747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:19.994011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:19.995101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:19.996573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:19.998143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 122/246] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:20.004346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.031447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.091699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.105086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9af6c8-5e42-4d8c-b44d-69a2aa631eaf None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.130805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.140567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.141174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.141455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.141725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] PATH_INFO: `/v3/groups` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.142353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.144369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.158598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 125/247] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Oct 14 17:42:20 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:42:20.159773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.220933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4b0b-d4ce-4aaf-a1df-d8fc6da79c5b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.254603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.261951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.262619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.262897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.263516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.273889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d6c4-c9e9-4e6b-aa59-217aecb0ac2b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.275102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:20.280712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:20.281732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:20.282779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 123/248] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:20.288244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.318845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.319644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.319967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.320296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.332209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:20.337759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:20.338648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:20.339489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 126/249] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:20.344813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.402607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.411519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c296676-f6b9-4ee5-b60c-dff6856fa2e4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.450542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.451429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.451923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.452335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.453150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:20.453616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.455157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.464970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 124/250] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:20.470871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.486495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ced728-d1cd-4d92-84db-2493229f10d5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.531203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.531910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.532127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.532396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.533064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:20.533361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.535459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.546688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 127/251] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:20.553155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.567603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.607064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64acff3-5394-47fe-b864-f21b5a3d4c7c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.644774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.645402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.645677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.645942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] PATH_INFO: `/v3/users/d6310780ef1e42dea31bb53be79508a1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.647106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] RBAC: Authorizing `identity:get_user(user_id=d6310780ef1e42dea31bb53be79508a1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.648581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.650419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 125/252] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/users/d6310780ef1e42dea31bb53be79508a1 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:20.660041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.693803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.719596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e3a1-544b-4926-b9da-fb23cc561f9f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.768937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.769877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.769995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.770213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] PATH_INFO: `/v3/users/7a4ec40421a84056ada0264f54866b97` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.771437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a4ec40421a84056ada0264f54866b97)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.773417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.775978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 128/253] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/users/7a4ec40421a84056ada0264f54866b97 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:20.783202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:20.789462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8553db-9451-4de0-9c07-a07b5e5e8027 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.826653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.828290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.828290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.828290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.828541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] RBAC: Adding query filter params (role.id=fe3e0f43a9894ab9a2c1553312375e0d, user.id=d6310780ef1e42dea31bb53be79508a1, scope.system=all) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:20.828834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.830297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd05e5b-d307-41f8-8454-86f95e5c0583 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.843866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 126/254] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Oct 14 17:42:20 2022] GET /identity/v3/role_assignments?user.id=d6310780ef1e42dea31bb53be79508a1&scope.system=all&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:20.889291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:20.905866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a910e34-ad0b-435f-b2e0-d585424bcbc6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:20.950636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:20.951389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:20.951671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:20.951946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] PATH_INFO: `/v3/system/users/7a4ec40421a84056ada0264f54866b97/roles/55eba99938a248729a99f8898b46461d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:20.953482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a4ec40421a84056ada0264f54866b97, role_id=55eba99938a248729a99f8898b46461d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:20.954942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c67adb-c7c1-4542-bb7e-28b8b61b5e93 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:20.965283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 129/255] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Oct 14 17:42:20 2022] PUT /identity/v3/system/users/7a4ec40421a84056ada0264f54866b97/roles/55eba99938a248729a99f8898b46461d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:22.781418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ae91-b8d9-47cb-9a3c-371a2f164637 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:22.782377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ae91-b8d9-47cb-9a3c-371a2f164637 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:22.782840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ae91-b8d9-47cb-9a3c-371a2f164637 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:22.784706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 127/256] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:22.790963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98e10-bd3c-4157-a4f5-b532f2732e39 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:22.791832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98e10-bd3c-4157-a4f5-b532f2732e39 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:22.792296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98e10-bd3c-4157-a4f5-b532f2732e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:22.820310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fef98e10-bd3c-4157-a4f5-b532f2732e39 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:22.821863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fef98e10-bd3c-4157-a4f5-b532f2732e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:22.900394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 130/257] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:42:23.098863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56569c38-1cda-47c8-8845-0c46d8af652e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.099218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56569c38-1cda-47c8-8845-0c46d8af652e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.099436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56569c38-1cda-47c8-8845-0c46d8af652e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.101130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 128/258] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:23.106274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.106562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.106834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.131743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:23.132955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:23.144733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 131/259] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:42:23.206774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56569c38-1cda-47c8-8845-0c46d8af652e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.225836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56569c38-1cda-47c8-8845-0c46d8af652e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.230248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.230881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.231153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.231455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:23.252132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:23.253555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:23.255831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 129/260] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:23.263063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.275119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402b188-03a0-441b-92b2-66c44d7c32a2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.284236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.284989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.285268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.285539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.286216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:23.286515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.288319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:23.288319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:42:23.288319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:42:23.289230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.300488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 132/261] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:23.306209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.318210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5bc33-cb88-46c4-921d-258e0b3bbc82 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.324405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.325044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.325316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.325583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.334990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.337119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:23.337119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:42:23.337119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:42:23.338343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.340333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 130/262] 10.222.0.26 () {56 vars in 1201 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:23.345660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.357291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2ea39-a1dc-4edc-97ca-bbaf226305db admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.367308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.367997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.368270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.368539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.376019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.378865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf8000-ec3b-465a-be99-a08dace2b2ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.380738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 133/263] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:23.386613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.404469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d51ca-bc2f-41a9-bf5b-7adac9e3146f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.414679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.415377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.415657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.415922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/groups/08b6445c94df424083ae181057c5e479/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.417826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, group_id=08b6445c94df424083ae181057c5e479, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.418849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:23.418849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:42:23.418849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:42:23.420827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f346ec-2eba-45ad-b738-1f193fbd5b42 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.449196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 131/264] 10.222.0.26 () {58 vars in 1463 bytes} [Fri Oct 14 17:42:23 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/groups/08b6445c94df424083ae181057c5e479/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:23.697323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47e0e-63b5-4e3b-ae1d-ff03551bb8bb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.697618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47e0e-63b5-4e3b-ae1d-ff03551bb8bb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.697857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47e0e-63b5-4e3b-ae1d-ff03551bb8bb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.699627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 134/265] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:23.705343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.705682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.705989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.720455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47e0e-63b5-4e3b-ae1d-ff03551bb8bb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.734008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:23.736265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:23.806604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:23.825270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 132/266] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:42:23.845816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47e0e-63b5-4e3b-ae1d-ff03551bb8bb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.854688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.855360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.855642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.855918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.884421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d93af8db-ceea-4ca1-afdc-38e8b3982c47 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:23.889792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:23.890644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:23.891449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 135/267] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:23.898814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.904391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05112e-f17d-46db-a678-8a41e86999f5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.904678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05112e-f17d-46db-a678-8a41e86999f5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.904951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05112e-f17d-46db-a678-8a41e86999f5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.906408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 136/268] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:23.912498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.912778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.913048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.915311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e348f-2ef8-4907-8b25-404c477e0cbb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.923364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.923982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.924291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.924741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.925533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:23.925833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.926905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:23.926905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:42:23.926905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:42:23.927998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.940315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:23.946189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 133/269] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:23.950395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:23.951630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:23.954317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:23.966858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634b1b2-c915-4440-818c-f991d67409b4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:23.978854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:23.979551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:23.979828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:23.980153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:23.981626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:23.983913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:23.986027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 134/270] 10.222.0.26 () {56 vars in 1201 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:23.991973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.008746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80890-03f0-4342-9871-9cd285375f02 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.015044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.016074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.016342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.020087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.022367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.025167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 135/271] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:42:23 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:24.029851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.044922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e07c2-405b-4ecc-9f66-a9564bf773dd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.051440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.052147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.052439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.052707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb/groups/08b6445c94df424083ae181057c5e479/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.061534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db85fbc44914b438b5e9789d24d01fb, group_id=08b6445c94df424083ae181057c5e479, role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.064356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.089674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 136/272] 10.222.0.26 () {58 vars in 1463 bytes} [Fri Oct 14 17:42:24 2022] PUT /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb/groups/08b6445c94df424083ae181057c5e479/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:42:24.094868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 137/273] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 14 17:42:24.254731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.333224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bae6cc-fa7f-4f63-b260-7f01eb230f78 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.341957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.342629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.342909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.343182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.359076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:24.364425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:24.365298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:24.366074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 137/274] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:24.371974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.384088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b4fb-a2ee-40c9-8a6e-17ec2eea3d74 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.388862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.389494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.389769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.390034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.390830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:24.391185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.392908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.407447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 138/275] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:24.409811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.420906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d330-c6ed-46e7-aaf0-e450dc69f9f6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.425772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.426418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.426743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.427016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.428308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.430297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.432319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 138/276] 10.222.0.26 () {56 vars in 1201 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:24.437493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.452969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435fc5-ee8c-484c-8ce2-8fc92a079162 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.462033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.462684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.462962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.463231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.467959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.470059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.472216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 139/277] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:24.478071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.492862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cb4f8-9901-4089-b755-ca4aaa4fbe93 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.501246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.502020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.502299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.503143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/groups/08b6445c94df424083ae181057c5e479/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.505329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, group_id=08b6445c94df424083ae181057c5e479, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:24.508145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:24.525321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 139/278] 10.222.0.26 () {58 vars in 1463 bytes} [Fri Oct 14 17:42:24 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/groups/08b6445c94df424083ae181057c5e479/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:24.595704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:24.739892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd219-1775-4388-a77d-18d514b261e3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:24.771077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:24.783694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:24.784297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:24.787308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:24.787603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:24.800732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c20042b1-44fd-40d9-bdad-0aa8bd026532 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:24.806157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:24.807055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:24.807864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 140/279] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:24.816736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.020360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:25.036504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb58a-8d74-44f3-b6a6-4cd1090d57d2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.088825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22d4b-4659-427d-b2f4-7e2d75441f4f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.089344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22d4b-4659-427d-b2f4-7e2d75441f4f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.089416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22d4b-4659-427d-b2f4-7e2d75441f4f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.091027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 141/280] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:25.097092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.097381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.097656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.110348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.110954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.111228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.111511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.112873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:25.113173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.114549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.129744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 140/281] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:25.132110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:25.133314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:25.136430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.239798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 142/282] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 17:42:25.318157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3896-c0a2-48fa-904d-d71242831c02 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.374800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.375474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.375754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.376022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] PATH_INFO: `/v3/users/7a4ec40421a84056ada0264f54866b97` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.377180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] RBAC: Authorizing `identity:get_user(user_id=7a4ec40421a84056ada0264f54866b97)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.378915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.380745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 141/283] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/users/7a4ec40421a84056ada0264f54866b97 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:25.386838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.527003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a11f-3188-4c3c-b786-8288c825a513 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.563887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:25.578418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.578955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.579234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.579530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.580262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] RBAC: Adding query filter params (role.id=55eba99938a248729a99f8898b46461d, user.id=7a4ec40421a84056ada0264f54866b97, scope.system=all) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:25.581102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.582545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.600321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 143/284] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/role_assignments?user.id=7a4ec40421a84056ada0264f54866b97&scope.system=all&role.id=55eba99938a248729a99f8898b46461d => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:25.845891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.857311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd8142-3803-47c5-a576-c7ae7bd6ee5c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.867780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.868423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.868695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.868962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.885881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:25.890661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:25.891555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:25.892336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 142/285] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:25.899232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.915666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9c7a-8f63-4f72-8b70-a3c222569e39 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.921081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.921745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.922019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.922288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.923013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:25.923346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.925233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.939408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 144/286] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:25.942406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.952594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709344-2148-49d4-835d-007c3c84a961 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.957470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.958103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.958450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.958699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.959928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.962180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.968450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 143/287] 10.222.0.26 () {56 vars in 1201 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:25.969789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:25.980710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6739ca6-8add-4cea-ae24-ad25f621fd9a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:25.985341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:25.985968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:25.986299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:25.986572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:25.987852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:25.990055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8c35-8d26-4596-8cf8-86b95ab236e9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:25.991939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 145/288] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:42:25 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:26.000197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:26.012486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e94f-35be-429b-87a2-b6da683c35a2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:26.018423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:26.019174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.019515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.019787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40/groups/08b6445c94df424083ae181057c5e479/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.023258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac77a05ae56446faea85b25b3b97a40, group_id=08b6445c94df424083ae181057c5e479, role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:26.026075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1fae3-45fb-4249-bd8a-698d0290fa3e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:26.029294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:26.047407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 144/289] 10.222.0.26 () {58 vars in 1463 bytes} [Fri Oct 14 17:42:25 2022] PUT /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40/groups/08b6445c94df424083ae181057c5e479/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:26.431647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21ad2-1147-43b8-a4d4-42cf21a7b8a8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.432365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21ad2-1147-43b8-a4d4-42cf21a7b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.432365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21ad2-1147-43b8-a4d4-42cf21a7b8a8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.433653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 146/290] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:26.439126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72663-a333-4815-b0b5-ed3697a7c8a8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.439438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72663-a333-4815-b0b5-ed3697a7c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.439712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72663-a333-4815-b0b5-ed3697a7c8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.461641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-74c72663-a333-4815-b0b5-ed3697a7c8a8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:26.462832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-74c72663-a333-4815-b0b5-ed3697a7c8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:26.536291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 145/291] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 17:42:26.711656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df78a-41a3-4de4-9e02-b8992cd9d7d5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.711983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df78a-41a3-4de4-9e02-b8992cd9d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.712195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df78a-41a3-4de4-9e02-b8992cd9d7d5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.713535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 147/292] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:26.725275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.725561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.725944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.760722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:26.761978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:26.843008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 146/293] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:26.907443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df78a-41a3-4de4-9e02-b8992cd9d7d5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:26.920044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df78a-41a3-4de4-9e02-b8992cd9d7d5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:26.925042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:26.925663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.925938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.926302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.940772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:26.945661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:26.946527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:26.947347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 148/294] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:26.952892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:26.964819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339479d-64c5-4ba9-a725-45263155a2ff None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:26.969349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:26.969967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:26.970242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:26.970508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:26.971847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:26.972154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:26.973872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:26.987529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 147/295] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:26.990164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.000922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912476c-04be-48c0-9caf-a507cb36b395 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.008120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.008822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.009101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.009416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] PATH_INFO: `/v3/groups/d15d806fe6054f72a3b8a41252d55c6b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.016644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] RBAC: Authorizing `identity:get_group(group_id=d15d806fe6054f72a3b8a41252d55c6b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:27.017791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:27.017791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:42:27.017791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:42:27.019656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:27.021358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 149/296] 10.222.0.26 () {56 vars in 1201 bytes} [Fri Oct 14 17:42:26 2022] GET /identity/v3/groups/d15d806fe6054f72a3b8a41252d55c6b => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:27.027386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.038682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0b446-9926-47e1-9486-04869bf2b886 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.045443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.046072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.046393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.046715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] PATH_INFO: `/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.047855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8a3a4fbbeb945ec99d62464efbbf393)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:27.050063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92792c89-ef9d-44fc-991e-2b620f1fac89 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:27.053067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 148/297] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Oct 14 17:42:27 2022] GET /identity/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:27.057327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.072802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d20a-403a-45fe-b656-57ff611ccbe1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.077506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.078208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.078480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.078785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] PATH_INFO: `/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393/groups/d15d806fe6054f72a3b8a41252d55c6b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.081558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a3a4fbbeb945ec99d62464efbbf393, group_id=d15d806fe6054f72a3b8a41252d55c6b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:27.082674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:42:27.082674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:42:27.082674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:42:27.084774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06754-0ca5-44a7-8246-92e26bf64d48 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:27.117135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 150/298] 10.222.0.26 () {58 vars in 1463 bytes} [Fri Oct 14 17:42:27 2022] PUT /identity/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393/groups/d15d806fe6054f72a3b8a41252d55c6b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:27.183018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696ab70-3c5c-428a-8f43-5bd7eb712483 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.183717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696ab70-3c5c-428a-8f43-5bd7eb712483 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.184187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696ab70-3c5c-428a-8f43-5bd7eb712483 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.186251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 149/299] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:27.192416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.192694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.192958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.221784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:27.223023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:27.229964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696ab70-3c5c-428a-8f43-5bd7eb712483 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.343475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:27.352133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 151/300] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:27.413121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696ab70-3c5c-428a-8f43-5bd7eb712483 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.451245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.451913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.452191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.452458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.464891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:27.470019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:27.470878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:27.471946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 150/301] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:27.479259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.556348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:27.591541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25741a2-95fa-474a-aa4c-64c52984d816 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.629223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.629833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.630194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.630460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.631171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:27.631502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:27.632910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:27.643646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 152/302] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:27.651492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.780357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d273df-8c34-42fd-b410-6d5b278cf301 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:27.804812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:27.832867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:27.833481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:27.833757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:27.834019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:27.879625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:27.919009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:27.920825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.061027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2b162-74bc-4657-a58f-ce0e066e40ee None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.113674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 151/303] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:28.115639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.120611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.132647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.133342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.133620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.133888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.151811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:28.152878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-51ddff37-9051-4071-8826-354e0d37061f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:28.158047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:28.159540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:28.160320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:28.162233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 153/304] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:42:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:28.169695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7be2-c227-4c0a-8431-aaef524fc702 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.169980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7be2-c227-4c0a-8431-aaef524fc702 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.170245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7be2-c227-4c0a-8431-aaef524fc702 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.172552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 154/305] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:28.173379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7be2-c227-4c0a-8431-aaef524fc702 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.271170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de23ff-c868-4ffe-bb8a-fbfb9b4b6b08 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.309607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.310233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.310340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7be2-c227-4c0a-8431-aaef524fc702 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.310497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.310766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.311949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:28.313320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fd517-bc1b-416a-aefc-5ca67854e83d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.316845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 152/306] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:28.318116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.318396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.318664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.338116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:28.339270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:28.360360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.361031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.361315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.361626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.363232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:28.363576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:28.365303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.375749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 155/307] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:28.376482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.423468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 153/308] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:28.424996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.441584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.451830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.509936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782381a-0c60-4f6b-861f-3b9c2c474b25 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.565316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ca710-327e-4003-b793-74b9c91fd97a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.571388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.572291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.572568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.572837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.574934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:28.576193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.583308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 156/309] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:28.609843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.639536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.641089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.641367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.641637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.758521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1fa74-d0ba-4cad-8258-6fdd31faf69f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:28.773562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:28.775221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.797393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:28.798003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:28.798280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:28.798549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:28.799500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] RBAC: Adding query filter params (group.id=08b6445c94df424083ae181057c5e479, role.id=fe3e0f43a9894ab9a2c1553312375e0d, scope.project.id=5db85fbc44914b438b5e9789d24d01fb) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:28.799882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:28.801940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:28.808421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.810093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:28.812255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 157/310] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/role_assignments?group.id=08b6445c94df424083ae181057c5e479&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:28.838700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:28.967080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 154/311] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:28.974429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.055544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f812d7e-9f01-4fbc-88ed-f6726d5c235f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.100735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.101702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.102188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.102644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.114143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-be50d32f-0d0e-4681-83bb-2827c77f625e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:29.120645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:29.121522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 17:42:29.122294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:29.124444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 158/312] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:29.125746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c0bf9-c2e8-46a4-9c0b-e7ef51e62d89 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.126094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8e07-b882-4c3d-80fa-85f4a7db82b4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.126643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c0bf9-c2e8-46a4-9c0b-e7ef51e62d89 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.127043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c0bf9-c2e8-46a4-9c0b-e7ef51e62d89 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.132750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 159/313] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:29.135174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c0bf9-c2e8-46a4-9c0b-e7ef51e62d89 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.143594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.171939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.172569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.172840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.173109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] PATH_INFO: `/v3/projects/5db85fbc44914b438b5e9789d24d01fb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.175392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] RBAC: Authorizing `identity:get_project(project_id=5db85fbc44914b438b5e9789d24d01fb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.176887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdf975-0f8b-4356-8ea4-04b4cba93b75 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.178821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 155/314] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:28 2022] GET /identity/v3/projects/5db85fbc44914b438b5e9789d24d01fb => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:29.184161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.184441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.184712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.200769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.205911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:29.207128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:29.273393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c0bf9-c2e8-46a4-9c0b-e7ef51e62d89 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.289632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 156/315] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:29.290805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.347231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.348260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.348735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.349309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.350430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] RBAC: Adding query filter params (name=member) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:29.351481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.353083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.372373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 160/316] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:29.379861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.433155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b4224-84dc-4436-bb56-3de0b5c252cb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.448140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.477027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.477661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.478354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.478354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.479396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.480897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.482697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 157/317] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:29.488330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.519868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638b562-f360-4128-87bc-a5c0f100e313 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.531503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.568408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.569021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.569289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.569550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.630142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ae6f4-20e7-4ebd-b3d6-67da87365829 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.655216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.657875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.685392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.686612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.687030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.687866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.688780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] RBAC: Adding query filter params (group.id=08b6445c94df424083ae181057c5e479, role.id=f2bf712db5ff4496beaf17fbf5cb2418, scope.project.id=5db85fbc44914b438b5e9789d24d01fb) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:29.689220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.693877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.702199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 158/318] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/role_assignments?group.id=08b6445c94df424083ae181057c5e479&scope.project.id=5db85fbc44914b438b5e9789d24d01fb&role.id=f2bf712db5ff4496beaf17fbf5cb2418 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:29.703028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.761256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.794935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 161/319] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:29.806873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.820336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:29.835381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1818d-d765-46cf-b3c0-15af4c4f6fd6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.878380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.879322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.879748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.880223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.892428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6ec89cab-0b84-41fb-a648-7271892891a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:29.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:29.900233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:29.901025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:29.903414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 159/320] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:29.909638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e32c-6cce-4355-ae04-9908c3b5456a None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.910221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e32c-6cce-4355-ae04-9908c3b5456a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.910821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e32c-6cce-4355-ae04-9908c3b5456a None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.912662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 160/321] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:29.914864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e32c-6cce-4355-ae04-9908c3b5456a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:29.935201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0793-4232-42fc-a1d2-7313ae025db3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:29.977185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:29.977881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.978154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.978626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:29.980093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:29.981569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c459-c764-48f5-941c-689457946ee9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:29.984288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 162/322] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:29.985447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:29.985722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:29.985989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.009022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:30.010602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:30.039531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e32c-6cce-4355-ae04-9908c3b5456a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.043526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.086209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.086824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.087102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.088368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 163/323] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:30.088477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.088477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:30.088600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.088681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.091364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.097651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.100028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 161/324] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:30.105937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.212058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bcf75-73d0-445e-a69f-5e6133cc530f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.230777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fec15-b59e-47a2-a5af-bad941f3884d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.267519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.268347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.268699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.268968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.270660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.272122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.273102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.273703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 164/325] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:30.273805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.274195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.274531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.279428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.315358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.362001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.363528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.373155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.405472 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa472a-b121-4e4f-aad9-344841a01cb5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.443006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.443661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.443942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.444215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.444956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] RBAC: Adding query filter params (group.id=08b6445c94df424083ae181057c5e479, role.id=fe3e0f43a9894ab9a2c1553312375e0d, scope.project.id=8ac77a05ae56446faea85b25b3b97a40) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:30.445263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.447998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.453880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 165/326] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/role_assignments?group.id=08b6445c94df424083ae181057c5e479&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=fe3e0f43a9894ab9a2c1553312375e0d => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:30.454867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.494110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 162/327] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 17:42:30.499835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.591031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.606047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675b24-44e5-4ef3-8d00-63b9f05818f9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.635409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761bc88-654a-462b-a257-96d24584c8e2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.645883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.646530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.646808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.647079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.659101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.663412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:30.671136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:30.672081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:30.672869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 166/328] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:30.677764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.678396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.678676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.679016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] PATH_INFO: `/v3/projects/8ac77a05ae56446faea85b25b3b97a40` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.680146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.682016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] RBAC: Authorizing `identity:get_project(project_id=8ac77a05ae56446faea85b25b3b97a40)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.687994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.691192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 163/329] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/projects/8ac77a05ae56446faea85b25b3b97a40 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:30.697657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.810883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7171b-d6d2-4da1-b8ca-c1ef0c424d74 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.820662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ac75-be2d-4031-af07-8d811e729359 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.851515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.852124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.852399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.852666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.853328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:30.853626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.854989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.864059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 167/330] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:30.864524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:30.865161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:30.865436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:30.865707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] PATH_INFO: `/v3/groups/08b6445c94df424083ae181057c5e479` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:30.866829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] RBAC: Authorizing `identity:get_group(group_id=08b6445c94df424083ae181057c5e479)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:30.868317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:30.869857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.870291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 164/331] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/groups/08b6445c94df424083ae181057c5e479 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:30.875722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:30.878455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.952710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:30.993159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f320e-bf57-4194-87d3-0a741881902f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:30.997568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e328ab-1e94-46e3-bdac-9aad7400f98f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:31.027104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:31.027733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:31.028010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:31.028276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:31.028987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] RBAC: Adding query filter params (group.id=08b6445c94df424083ae181057c5e479, role.id=f2bf712db5ff4496beaf17fbf5cb2418, scope.project.id=8ac77a05ae56446faea85b25b3b97a40) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:31.029292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:31.030698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:31.031230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:31.031854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:31.032134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:31.032401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:31.036866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 165/332] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/role_assignments?group.id=08b6445c94df424083ae181057c5e479&scope.project.id=8ac77a05ae56446faea85b25b3b97a40&role.id=f2bf712db5ff4496beaf17fbf5cb2418 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:31.103160 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:31.104573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:31.164304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:31.207957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 168/333] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 17:42:31.213859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:31.278740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:31.315377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044289d-bc6a-4815-901f-f891cc4e3cf7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:31.348434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:31.349062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:31.349334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:31.349594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] PATH_INFO: `/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:31.350701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] RBAC: Authorizing `identity:get_project(project_id=b8a3a4fbbeb945ec99d62464efbbf393)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:31.352157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:31.353823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 166/334] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:42:31 2022] GET /identity/v3/projects/b8a3a4fbbeb945ec99d62464efbbf393 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:31.359378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:31.457060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965962d-182e-4222-a0aa-1467aaf1ac08 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:31.489625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:31.490232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:31.490507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:31.490771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] PATH_INFO: `/v3/groups/d15d806fe6054f72a3b8a41252d55c6b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:31.491847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] RBAC: Authorizing `identity:get_group(group_id=d15d806fe6054f72a3b8a41252d55c6b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:31.493247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf71b-9ec7-49f1-b0e9-6723906d4c24 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:31.494802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 169/335] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Oct 14 17:42:31 2022] GET /identity/v3/groups/d15d806fe6054f72a3b8a41252d55c6b => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:31.500646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:31.595898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c7d4-e02f-4126-83b4-c84e136aa39f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:31.628352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:31.628865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:31.629139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:31.629405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:31.630109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] RBAC: Adding query filter params (group.id=d15d806fe6054f72a3b8a41252d55c6b, role.id=87f9d55d22b7471e941216189675256a, scope.project.id=b8a3a4fbbeb945ec99d62464efbbf393) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:31.630409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:31.631839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1602ff-6ab4-468b-baf1-62c12655d047 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:31.633607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:31.638284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 167/336] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Oct 14 17:42:31 2022] GET /identity/v3/role_assignments?group.id=d15d806fe6054f72a3b8a41252d55c6b&scope.project.id=b8a3a4fbbeb945ec99d62464efbbf393&role.id=87f9d55d22b7471e941216189675256a => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:34.354249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7247f-5aa9-498e-a6a2-5eb319f1d5fe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.355308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7247f-5aa9-498e-a6a2-5eb319f1d5fe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.355831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7247f-5aa9-498e-a6a2-5eb319f1d5fe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.357920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 170/337] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:34.364236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49919c8-b4e7-4671-a207-12b8f285a57b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.365104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49919c8-b4e7-4671-a207-12b8f285a57b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.365543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49919c8-b4e7-4671-a207-12b8f285a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.392727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e49919c8-b4e7-4671-a207-12b8f285a57b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:34.394672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e49919c8-b4e7-4671-a207-12b8f285a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:34.486458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 168/338] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:34.653387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2711e-afb7-4596-9058-c1f441b7b8f5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.653576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2711e-afb7-4596-9058-c1f441b7b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.654065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2711e-afb7-4596-9058-c1f441b7b8f5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.655935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 171/339] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:34.661722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e603-b213-4919-a6b6-bb3a290cd6c3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.662071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e603-b213-4919-a6b6-bb3a290cd6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.662405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8e603-b213-4919-a6b6-bb3a290cd6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.691505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9dd8e603-b213-4919-a6b6-bb3a290cd6c3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:34.692982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9dd8e603-b213-4919-a6b6-bb3a290cd6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:34.797842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 169/340] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:34.815801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2711e-afb7-4596-9058-c1f441b7b8f5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:34.822710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198ca7-5ae4-4a93-9bf1-515f2d9c7f1b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.822710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198ca7-5ae4-4a93-9bf1-515f2d9c7f1b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.822710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198ca7-5ae4-4a93-9bf1-515f2d9c7f1b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.822710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 170/341] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:34.827590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:34.828034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:34.828445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:34.863009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:34.865584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:34.871207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:34.976884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:34.994001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2711e-afb7-4596-9058-c1f441b7b8f5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.017670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 171/342] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:35.046694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.047617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.048037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.048446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.061657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.063302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:35.085594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:35.087026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:35.092278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:35.092278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.092278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:35.094083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 172/343] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:35.100652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.133015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.227686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae116c36-b477-4385-a38a-0b57dbaae276 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.249509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:35.264917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.265754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.266202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.266703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.268137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:35.268811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.270625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b15c1-dc11-4754-95d3-6c739792e1d9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.274085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f4d0-eb74-4ef1-b128-1a607564da76 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.282878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 172/344] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:35.285394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a96be-25fd-496e-ac96-a0d76349abac None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.285889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a96be-25fd-496e-ac96-a0d76349abac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.286355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a96be-25fd-496e-ac96-a0d76349abac None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.288021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 173/345] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:35.289220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a96be-25fd-496e-ac96-a0d76349abac None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.326237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.326891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.327408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.327713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.342672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.344837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.351316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-202893db-67fd-4fc5-99e2-f8eb45495532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:35.361265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:35.362516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:35.364436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:35.364436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.364436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:35.364436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 173/346] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:35.368424 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.368711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.368985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.387749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:35.388959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:35.409849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a96be-25fd-496e-ac96-a0d76349abac None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.443924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.444528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.444802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.445065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.445705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.447129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.463396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 174/347] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:35.483395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 174/348] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:35 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:35.483395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.483689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.632257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:35.694690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284713-995c-4a09-8517-78ff67ceafdd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.698353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318ba07-a251-408c-90e8-c501becb6c2b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.701325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:35.735744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.736859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.737132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.737391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.741523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.742137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.742414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.742678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.744099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:35.744099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.745532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f687a0-2e68-4c76-867f-7997f2db32b5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.749418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.750358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.759304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 175/349] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:35.760551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b395-c7a5-4e69-a5b4-3f7be10ab0b3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.760837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b395-c7a5-4e69-a5b4-3f7be10ab0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.761107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106b395-c7a5-4e69-a5b4-3f7be10ab0b3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.762470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 176/350] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:35.762999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b395-c7a5-4e69-a5b4-3f7be10ab0b3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:35.774959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:35.776032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:35.776901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:35.776901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.776901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:35.776901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 175/351] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:35.776901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.877990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106b395-c7a5-4e69-a5b4-3f7be10ab0b3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.883491 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9e1bb-f0c7-4b3c-b317-a5866447716a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:35.900620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:35.916732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.917589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.917867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.918142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.924599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:35.925668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.925955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.926227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.927287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.928760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:35.929040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.930178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4d555640-d572-46b7-8fd5-30a662fc6d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:35.948124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:35.949291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:35.950197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:35.950197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:35.950197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:35.950197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 177/352] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:35.950769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:35.951046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:35.951336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:35.958385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 176/353] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:35 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:35.960267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:35.971313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:35.972533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:35.985650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:36.061519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:36.062563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.096629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2847e6-2893-4c7d-917d-1a4f3108f50e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.133381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.133996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.134267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.134529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.135185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:36.135512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.136946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:36.150388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 177/355] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:36.155939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.172347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c02a7-aa68-45f4-bf30-101e761bb2d2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.201939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:36.211532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.212205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.212480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.212801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.213466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:36.213858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.215911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:36.229107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 179/356] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:36.240410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.254065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:36.290850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595ef7-e4ea-4c1d-bc4f-3b90be1a70d0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.339156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.340536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.340958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.341371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.342215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.344673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:36.372779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279801-91a1-4c1c-84ea-057149e1aef0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.379747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 178/357] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:36 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:36.434913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.435589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.435852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.436123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.436803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.438281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:36.455992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.478271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 180/358] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:36 2022] POST /identity/v3/users => generated 249 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:36.568894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:36.588394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3de68e-0e37-4086-abe2-39c9dc7588f7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.633884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.634425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.634695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.634961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.635692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.637075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:36.648013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 17:42:36.648013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 17:42:36.648013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [parameters: {'id': 'f64bade28b5b4fadac593a80ff9cd035', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 17:42:36.648013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:42:36.655631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return ref.to_dict() Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:42:36.656592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 17:42:36.657598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 17:42:36.658541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:42:36.660729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:42:36.662743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': 'f64bade28b5b4fadac593a80ff9cd035', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:36.664799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 17:42:36.666655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:36.668646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 179/359] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Oct 14 17:42:36 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:36.668777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.742477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:36.785409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206c22-9ca4-418d-9e73-88f73f904115 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.824868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.825502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.825772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.826032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.837228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a27c1c6a-5003-4dc5-9035-2b99aa05ec95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:36.842594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:36.846546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:36.848588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 181/360] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:36.852682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:36.955473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ade88-71b3-45dd-8cf5-816c9af5a828 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:36.990660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:36.991259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:36.991599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:36.991865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:36.992581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:36.992881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:36.994230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd97bd-7374-4dc0-8d1f-25d8df980ee9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:37.003767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 180/361] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:38.274225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925a56-d6a5-4ec9-bec8-7a138d3139ec None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.274739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925a56-d6a5-4ec9-bec8-7a138d3139ec None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.274739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925a56-d6a5-4ec9-bec8-7a138d3139ec None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.276378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 182/362] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:38.281458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.281932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.282095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.301701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:38.302981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:38.311845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:38.378189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 181/363] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:38.648918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46925a56-d6a5-4ec9-bec8-7a138d3139ec None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:38.761675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46925a56-d6a5-4ec9-bec8-7a138d3139ec None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:38.786058 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:38.798092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:38.798742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.799739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.799951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.811038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-d4137b85-c5f7-46d3-8797-cce7cd90d2ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:38.816002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:38.816897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:38.817718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:38.818837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 183/364] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:38.825423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:38.930169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdafd2-c905-4004-86f7-ed2a613851f4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:38.949645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537d91-aca7-41d1-9de2-25569551b83b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.949917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537d91-aca7-41d1-9de2-25569551b83b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.950233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d537d91-aca7-41d1-9de2-25569551b83b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.951589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 184/365] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:38.957515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.957799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.958071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.970061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:38.971602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:38.971874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:38.972139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:38.972810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:38.973104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:38.974522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:38.984168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 182/366] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:38.990283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:38.996016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:38.997198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:39.007343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.108589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe102c-aa03-4ee9-bf42-4634cde35474 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.145794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.146426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.146881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.147151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.159020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:39.161151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2777c794-c942-41c0-aad5-a0a1e8c1c675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:39.179086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:39.180087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:39.181417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:39.181417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:39.181417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:39.181417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 183/367] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:39.186609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 185/368] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:39.186820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc626cc-d133-408f-b3e3-f31f240e7fb0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.187212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc626cc-d133-408f-b3e3-f31f240e7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.187518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc626cc-d133-408f-b3e3-f31f240e7fb0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.188515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.189062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 184/369] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:39.196429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb510e-8c6b-4fb8-8541-959ddbde8852 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.196759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb510e-8c6b-4fb8-8541-959ddbde8852 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.196963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb510e-8c6b-4fb8-8541-959ddbde8852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.219640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-81bb510e-8c6b-4fb8-8541-959ddbde8852 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:39.221916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81bb510e-8c6b-4fb8-8541-959ddbde8852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:39.284106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.295741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 185/370] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:39.307537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64138-5bc8-4858-ad1e-86247950a93b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.307847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64138-5bc8-4858-ad1e-86247950a93b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.308090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64138-5bc8-4858-ad1e-86247950a93b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.309674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 186/371] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:39.314871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.315200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.315512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.343428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:39.344616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:39.414988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ffad-c2eb-48ca-acdd-ba0dd3951001 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.443712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.465885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 187/372] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:39.480508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.481129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.481454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.481729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.482380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:39.482678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:39.484080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:39.498464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 186/373] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:39.503750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.524503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.634979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9961fb-4b74-42fb-b46d-56f2df3297d4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.679502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.680181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.680460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.680724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.685282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18e5a-133e-49d9-83b9-36042d797c66 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.692433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:39.698891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:39.700007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:39.700970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 187/374] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:39.701620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.714764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.735688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.737130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.737581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.738026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.739428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.747015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:39.748726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:39.765018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:39.766010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:39.766918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:39.774578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 188/375] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:39.776027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.820543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57e057-faae-4c0a-865d-e827526385bc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.856472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.857106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.857386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.857654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.868951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:39.873774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:39.874649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:39.875492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 188/376] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:39.876227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.892802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab06480-12b0-4209-8bc6-50a7aaa18bb2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:39.926343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:39.926937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:39.927212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:39.927505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:39.928165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:39.928460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:39.929821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:39.937452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 189/377] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:39.938215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:39.972470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.976547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:39.983196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a55f7-56fd-4003-b3fc-f4c1da536110 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.017540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.018132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.018396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.018662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.019409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.019707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.021129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.035317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879fcfc-508a-43e9-a8ec-1a3cc6340e9e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.056429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 189/378] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.057240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.071133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.071825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.072104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.072375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.082680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a14e5547-bfdc-45d5-b319-5ad7bcd77a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:40.087732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.088795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:40.089607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 190/379] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.090262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd60-d74c-40b6-a66d-efc7e65c3558 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.090262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd60-d74c-40b6-a66d-efc7e65c3558 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.090539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd60-d74c-40b6-a66d-efc7e65c3558 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.092066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 191/380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:40.092723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fd60-d74c-40b6-a66d-efc7e65c3558 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.166084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67637b-3eb7-45c7-ac88-e322dc43d8f0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.189041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.194266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fd60-d74c-40b6-a66d-efc7e65c3558 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.199353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.199954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.200233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.200502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.201155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.201452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.202822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.211298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 190/381] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.212243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.227725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.234375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.235000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.235352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.236054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.246471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.247931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:40.262698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.263678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:40.264522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:40.264522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.264522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:40.264522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 192/382] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.264748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.314147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d72ef-cfd9-48ff-9a8d-861f8e93e9e4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.346930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.347575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.347845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.348108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.358104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.359526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.365309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498afb6-ea55-4cd4-9f76-fe202728f6d2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c322efa6-a63e-4500-9284-99aa98a577c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:40.373523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.374427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:40.375266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:40.375266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.375266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:40.375266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 191/383] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.376417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.376712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.377556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.395090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:40.396290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:40.402008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.402602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.402875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.403145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.403823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.404117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.405461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.413178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 193/384] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.413933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.429617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.454362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.463220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 192/385] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:40.464048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.519100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863747ca-3058-44c0-bead-dd9b776b3083 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.556534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.557166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.557444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.557713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.568763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.570191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.570710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ad6d-59dc-46e2-808a-45c17763175c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:40.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.587953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:40.588787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:40.588787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.588787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:40.588787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 194/386] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.589005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.608607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.609214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.609491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.609760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.610401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.610700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.612786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.629080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 193/387] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.629080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.662996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.686519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.711241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25e498-04e0-4e75-a982-d3bb8a9ea015 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.735180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e31a-88f8-4f2e-972f-0c0e2480a0cb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.746681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.747322 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.747604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.747878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.748513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.748814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.750167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.762388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 195/388] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.763230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.774395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.775023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.775321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.775589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.785990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.787481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:40.801383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.802398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:40.808057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:40.808057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:40.808057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:40.808057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 194/389] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.808057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.863137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdd7e-e9ef-4d27-9a14-79a8a5197b7f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.887672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.898959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.899587 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.899861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.900126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.900759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:40.901063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.902413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.906559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8274-7c18-41d9-b68e-13fb780d4867 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:40.913380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 196/390] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:40.913782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:40.915146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:40.941165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:40.941798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:40.942073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:40.942339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:40.949178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:40.950621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:40.963760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:40.964837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 195/391] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:40.965723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.016145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54819-dd53-4bf6-8dea-1076309142d3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.048461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.049111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.049387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.049654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.059841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.061257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.063560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd2838-f8af-4ac2-9182-c524eecbd4c1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:41.075258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:41.076191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:41.077454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:41.077454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:41.077454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:41.077454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 197/392] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:41.077454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.099286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.099925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.100195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.100456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.106830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.108292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.112434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:41.119786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:41.120632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 196/393] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:41.121583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.149550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.184183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47b0f-5124-41e8-ae26-14c22eb35c1b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.218101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.218701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.218980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.219258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.219936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:41.220312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.221625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.222300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ee588-5473-417a-8474-37f97ea13def None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.233163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 198/394] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:41.233953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.256603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.257245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.257521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.257786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.265316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.266761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:41.278482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:41.279609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 197/395] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:41.280792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.331333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.337707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeeb49-b6fa-4a95-9ad2-8799c9a46df9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.363900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.371725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.372331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.372607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.372879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.373612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:41.373918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.375353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.379375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88567dbb-be0d-4d58-b548-9997e4e57e98 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.411563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 199/396] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:41.412290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.412394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.412984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.413264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.413538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.414173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:41.414477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.415881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.428763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 198/397] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:41.429401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.515479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d806eca-fc64-4cf0-be87-c7037edac74d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.527137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6761-6f9c-4e6b-aeea-ad0bee61683a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.548484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.549060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.549338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.549603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.550298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:41.550574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.552027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.560409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.561030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.561306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.561572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.568940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.569869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 200/398] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:41.570366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.570666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:41.584011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:41.589821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 199/399] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:41.590977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.592802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.594518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.669873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002fd9-01b1-4225-ac4b-9d7f1f78e00f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.682287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f72b5-c8b3-4b07-b7d3-e03a484ff1b5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.707585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.708192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.708466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.708734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.709460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:41.709762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.711463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.716299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.716915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.717192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.717456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.728281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.729710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.729947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 201/400] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:41.730803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:41.744055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:41.745123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:41.750586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:41.750586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:41.750586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:41.750586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 200/401] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:41.750586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.798275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.805126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:41.827640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caec78-5144-4d6e-b154-fe64d89e8148 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.847474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20119c2-d784-456a-8f87-441483e317dc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:41.860559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.861158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.861431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.861691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.862322 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.863778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.880418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:41.881077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:41.881355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:41.881623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:41.886988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 202/402] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:41 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:41.887864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:41.897520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=fa4114e2020f4135bb6220c7e3aedc5c, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:41.899021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:41.914152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:41 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:41.916338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.018441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa2c-8ec1-414f-a3ff-3f7227057093 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.051133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.062993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.063894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.064186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.064693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.065652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:42.066032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.067743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.089050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616120b0-4927-4da1-893f-55ced58768a7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.094666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 203/404] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:42.095664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.103582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.134796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.135574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.135855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.136127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.147543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.155318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:42.170075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:42.171103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:42.172017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:42.172017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:42.172017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:42.172017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 202/405] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:42.172678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.215617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61937a-333a-43a1-a35c-b6a3901c39a6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.252221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.252827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.253107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.253375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.254070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:42.254370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.255969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.268629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 204/406] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:42.269463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.306486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c588-eb7c-4d0f-858d-03a833eb7ecb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.327218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.344381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.345003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.345275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.345776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.358593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.360508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:42.376103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:42.377878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:42.378930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:42.378930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:42.378930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:42.379932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 203/407] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:42.380959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.399580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.404766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d015a-eba8-4d20-b28a-d6551fcbe8e6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.447221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.447850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.448125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.448393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.449027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:42.449321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.450686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.464168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 205/408] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:42.468259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.522670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b6db-91b3-46f3-b552-0b97d009b0a3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.560441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.561073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.561312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.561674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.568899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.570303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:42.582173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:42.583052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 204/409] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:42.584090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.590703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fa81-f454-4fd9-93b2-98e158e7720c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.600139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.631947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.632625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.633014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.633377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.634114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:42.634508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.636056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.650212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 206/410] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:42.651227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.675842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.713769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f6a6-12da-4221-b501-9bf494d28938 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.748250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.748874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.749150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.749419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.756859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.758327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:42.770132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:42.771016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:42.771893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 205/411] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:42.772842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.786423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a344b05-0b13-4dca-95b4-bf4ce7d6ef13 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.825025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.825639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.826029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.826304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.827001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:42.827319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.828977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.844672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 207/412] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:42.845813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.878907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b164f-0811-4969-98ce-f88c44275792 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:42.879416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.909838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:42.915172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:42.915840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:42.916564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:42.917110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:42.924911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:42.926437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:42.938351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:42.939885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:42.940854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 206/413] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:42.941317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:42.971766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647459-9f1e-4609-84bb-2b27b1a67262 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:43.009447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:43.010258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:43.010686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:43.011096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:43.012140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:43.012686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:43.014314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:43.031587 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 208/414] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:43.032740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:43.043708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f2ef-ca0d-465f-81a7-60a2a4b7e49e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:43.078027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:43.078942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:43.079052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:43.079258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/00b73010bdce438b846bd93f8a511634/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:43.095209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=00b73010bdce438b846bd93f8a511634, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:43.096812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:43.113483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 207/415] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:42 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/00b73010bdce438b846bd93f8a511634/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:43.114552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:43.133379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:43.155381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46236c53-0ff7-43f3-9a34-ead86aef9936 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:43.174007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:43.197789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:43.198766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:43.199317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:43.199815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:43.200714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:43.201232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:43.202921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:43.218344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 209/416] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:43.224375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:43.245020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45e070-cad4-4bd1-8647-20a84bd251fd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:43.317904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:43.318947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:43.319468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:43.320031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/adb92f3a165d47daa47b9de4707b1792/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:43.337864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=adb92f3a165d47daa47b9de4707b1792, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:43.339733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56904cc5-9751-4bd0-93e0-92469409939d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:43.363363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 208/417] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:43 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/adb92f3a165d47daa47b9de4707b1792/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:43.409771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9da73-2415-4ae2-a3f0-fbc2340ecc14 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:43.451144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:43.451959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:43.452242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:43.452515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fdb70aefb254402ea472c80b81124cfc/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:43.471722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=fdb70aefb254402ea472c80b81124cfc, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:43.473314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698d3b3-34f0-441a-9ec8-36c7337904ab None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:43.476881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:43.498930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 210/418] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:43 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fdb70aefb254402ea472c80b81124cfc/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:42:44.261896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c659-b316-46d5-99cc-0298fae4c7b5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:44.262940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c659-b316-46d5-99cc-0298fae4c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:44.263462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437c659-b316-46d5-99cc-0298fae4c7b5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:44.265454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 209/419] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:44.271400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e56a4-b68e-4730-a474-815b61900fa9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:44.272012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e56a4-b68e-4730-a474-815b61900fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:44.272500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e56a4-b68e-4730-a474-815b61900fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:44.293664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9d6e56a4-b68e-4730-a474-815b61900fa9 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:44.294880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d6e56a4-b68e-4730-a474-815b61900fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:44.372190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 211/420] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:44.414352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5535e6-f21c-4b70-8143-9c4b8d94f3cf None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:44.414992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5535e6-f21c-4b70-8143-9c4b8d94f3cf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:44.415493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5535e6-f21c-4b70-8143-9c4b8d94f3cf None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:44.417274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 210/421] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:44.422572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:44.423005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:44.423184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:44.441953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:44.443489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:44.520200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 212/422] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:44.797036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5535e6-f21c-4b70-8143-9c4b8d94f3cf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:44.855941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:44.947636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:44.950611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:44.967244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5535e6-f21c-4b70-8143-9c4b8d94f3cf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.034904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.035563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.035840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.036111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.038345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9340c7-a046-4830-99db-f5628984b05c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.060490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:45.065806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:45.066685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:45.067839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 211/423] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:45.076778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.108000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.108996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.109470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.109929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.133952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:45.139672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:45.140544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:45.141316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 213/424] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:45.147745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.270818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23714e-4370-4830-86d8-484704e1eb9d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.343981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d314ee1-bbed-48b2-812d-9d7195231199 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.346590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.347196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.347498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.347769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.348437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:45.348740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.350131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:45.371014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:45.378277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 212/425] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:45.385909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.408561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.409186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.409463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.409728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.410399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:45.410699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.412106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:45.419629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:45.421437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 214/426] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:45.426778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.566061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560bfd-ce7f-458c-b3db-5681f5f7edc6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.608710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185c34c-a5de-4003-bb8e-2fff5f5c26d9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.630291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.630926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.631203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.631498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.643908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.645747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:45.661776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:45.662696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:45.663551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:45.663551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:45.663551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:45.663551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 213/427] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:45.672214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.689534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.690507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.690970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.691474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.710559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.712300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:45.741963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:45.742915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:45.743813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:45.743813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:45.743813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:45.746618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 215/428] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:45.748718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.807409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:45.808889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:45.888739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad348-eda7-47bb-b042-f86dbcbdb04e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.944539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.945413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.945837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.946256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.946876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646cce5-c33e-491b-b385-184ade97f023 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:45.947223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:45.947712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.949226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b489fb-1d07-406b-99ad-5559d1f135b0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:45.963024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 214/429] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:45.964568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d34f9-a36c-4b5e-ac41-81933007be32 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.965018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d34f9-a36c-4b5e-ac41-81933007be32 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.965433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d34f9-a36c-4b5e-ac41-81933007be32 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.967031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 215/430] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:45.968529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d34f9-a36c-4b5e-ac41-81933007be32 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:45.996454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:45.996957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:45.997238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:45.997508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:45.998148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:45.998448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:45.999850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee645f-c2b7-4ffc-8095-eb6c0df94f4b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.017166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 216/431] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:46.017166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98fb-0779-4857-9a9f-b9ca83e87445 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.017166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98fb-0779-4857-9a9f-b9ca83e87445 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.017166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98fb-0779-4857-9a9f-b9ca83e87445 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.019492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 217/432] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:46.021312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.021605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.021877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.040421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:46.041610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:46.086391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d34f9-a36c-4b5e-ac41-81933007be32 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.113359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 218/433] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:46.114493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.120708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.130435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.131130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.131441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.131760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.141632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.143894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.151486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a2d6031e-5728-4c94-9bfe-178d678dccee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:46.162140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:46.163236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:46.164241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:46.168500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 216/434] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:42:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:46.169850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.170169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.170437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.194302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:46.195539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:46.254644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b75e-93b1-4b58-b98f-88b213f6dbb6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.269064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 217/435] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:46.269972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.294981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.295897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.296344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.296814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.305143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.307550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b1035c91-0e0a-4e66-83fd-d21f1be20ab5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:46.319831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:46.320742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:46.321696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:46.324253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 219/436] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:46.325824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a95b64-0d6d-402b-a14f-ef974d5b357a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.326240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a95b64-0d6d-402b-a14f-ef974d5b357a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.326642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a95b64-0d6d-402b-a14f-ef974d5b357a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.328290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 220/437] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:46.329299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a95b64-0d6d-402b-a14f-ef974d5b357a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.383293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3dd5-d267-4db2-a6f5-0c1a935965ac None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.402695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.422678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.423285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.424476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.424747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.425467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:46.426111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.427886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289cd18-09c5-4d52-bb0c-054688c082bb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.429681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.446522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 218/438] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:46.447590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.447868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.448137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.456126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a95b64-0d6d-402b-a14f-ef974d5b357a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.465783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:46.467055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:46.492410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.493307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.493605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.493863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.494613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:46.494900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.496366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.514324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 221/439] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:46.515126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.544212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 219/440] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:46.545091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.631046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ea668-60f0-429f-8268-b22a8a53cf31 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.649027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1dacf-19fd-47ad-b195-d52965f16ab8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.652292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.667523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.668104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.668385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.668655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.676890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.680955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:46.686225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:46.687117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:46.687938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:46.692922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 222/441] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:46.693788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.696746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.697601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.698728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.699005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.771216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.772816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.803189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185e4c-2212-4906-a2d2-788dae7ce22f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.839540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:46.840165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:46.840437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:46.840704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:46.851005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:46.852471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:46.867914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:46.869097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:46.870173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:46.870173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:46.870173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:46.870173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 223/442] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:46.870435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.879285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 220/443] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:46.880126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:46.883089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.923078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:46.974389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453be4-2c53-473a-9066-5af8c51aea74 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:46.979585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5db06-301c-4af6-8d85-d0a2afd05040 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.007507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.008119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.008394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.008661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.014450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.015062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.015356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.015626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.016283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.016580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.017993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.018611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:47.023799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.024710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:47.025499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 224/444] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.026555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.026722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 221/445] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.026808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.091835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.129543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532d738-3bc6-4202-9014-5c9a7a711083 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.129749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca581f3-cdde-4406-8cc0-3c6ff84f4a85 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.139884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.163543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.164136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.164409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.164675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.165126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.165307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.165605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.165737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.166012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.166280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.166969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.176883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:47.179147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 222/446] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.179986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:47.181975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.182890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:47.183787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 225/447] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.184477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.278741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf596a8-04ef-48a2-8af8-9eeceb977146 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.285507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2cab5-ae5a-461b-873b-f775c64d0df4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.303682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.312518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.313145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.313421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.313686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.318648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.319235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.319546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.319810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.320466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.320759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.322119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.323538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.324961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.335107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 226/448] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.335107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:47.340268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.341321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:47.347627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:47.347627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.347627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:47.347627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 223/449] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.347627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.368493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.437828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee3d33-0088-445a-ae91-44fe073a05f6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.445038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd062b-c012-410e-8158-bfb3090c2ce5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.471289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.471923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.472193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.472453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.478805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.479451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.479727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.479996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.482497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.483963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.486736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.488189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:47.497450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.498388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:47.499247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:47.499247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.499247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:47.499465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.500219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:47.501075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 224/450] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.501527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.503534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 227/451] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.504400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.542702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.588507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.604412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0813d33-8863-4e52-84de-e199873f0704 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.605434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16390bd9-583a-45d6-83e7-0af12ac59a82 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.637941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.638650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.638923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.639199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.640023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.640136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.640377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.640647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.640927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.641196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.641836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.650425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 225/452] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.651315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.651717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.653134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:47.668670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.669588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:47.670430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:47.670430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.670430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:47.670430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 228/453] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.670728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.752383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.755573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee9cc2-752c-4ab3-8843-e57e7e9bbb47 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.773526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e197cf-33f1-41d7-aa7b-2aae3599600a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.788611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.789203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.789473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.789744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.790364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.790658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.792027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.803803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 226/454] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.804571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.808648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.809259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.809538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.809807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.810475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.810775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.812178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.814544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.825113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 229/455] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.825973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.904595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6107f0e-b6a6-4293-9731-a7afb2cb20aa None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.924968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcbd5-efb0-481d-a0fb-b16090392cdb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:47.938326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.938919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.939359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.940045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.940726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:47.941031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.942501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.959185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:47.959831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:47.960096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 227/456] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:47.960188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:47.960362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:47.961140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:47.974354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:47.975834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:47.982559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:47.990342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:47.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:47.997224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:47.997224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:47.997224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:47.997224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 230/457] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:47.997224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.040922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.063082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1d90-f1e1-4c92-9933-814ff9de5f07 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.092637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953f4d-9bcc-4fc0-b6d3-0dddf1f07baa None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.096089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.096687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.096963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.097232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.097862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.098162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.099574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.110542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 228/458] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.112260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.129921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.130824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.131105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.131396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.137892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.139323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:48.151439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:48.152455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:48.153329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 231/459] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:48.153833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.196452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.216753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eee71b-e0f4-48c4-9687-f7d894c8ae09 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.250182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.250667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7950-fdcd-4aa1-a4d8-ce03b41ca825 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.250787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.251054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.251345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.258640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.259886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.260102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:48.272203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:48.273267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:48.274160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 229/460] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:48.274739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.286191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.286838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.287122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.287412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/565161def47f4b29a23f10fce8783d2b/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.301964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=565161def47f4b29a23f10fce8783d2b, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.303544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.316385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 232/461] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:48 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/565161def47f4b29a23f10fce8783d2b/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:48.317169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.390364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9fa42-676d-4d9a-ae57-e3c934158e43 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.430338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.430956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.431231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.431525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.432234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.432537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.433954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.441400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045dcb-dd7d-47bf-a2a9-af108f2004a7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.445798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.454002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 230/462] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.455524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.484444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.485249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.485862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.486178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.496484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.497946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:48.510960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:48.511933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:48.512823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 233/463] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:48.513374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.532638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.571971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17ce0-fc2d-4133-8e3b-85684486b6d5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.611403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.612316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.612739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.613177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.614065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.614509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.616082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.622743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23edeb-9226-4875-8b59-790a26602df0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.633105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 231/464] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.633105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.662168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.662773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.663050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.663410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.664066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.664371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.665828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.693206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 234/465] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.693535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.696073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.740567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88449caa-2d37-4173-8375-00dbd6b05742 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.774971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.775618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.775891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.776153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.777094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.786000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.787492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:48.799953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:48.800888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:48.801781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 232/466] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:48.802335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.811639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e1bcc-c83e-404d-bf83-e7f944686630 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.847238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.847972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.848252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.848522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.849253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.849544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.850962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.869673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 235/467] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.870547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.912731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec84-1fbe-4c79-a97b-c912842a5cc4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:48.935241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:48.950776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:48.951408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:48.951803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:48.952075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:48.952804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=fa4114e2020f4135bb6220c7e3aedc5c) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:48.953136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:48.954734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:48.961778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 233/468] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/role_assignments?user.id=fa4114e2020f4135bb6220c7e3aedc5c&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:48.962573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:48.996767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ce45-ebde-41ab-9b69-ccdc2fee6942 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.037579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.038272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.038556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.038823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.041857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.096344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41d96-e81b-43cc-9dd9-e42f7839bca1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.115967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.117562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.136134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.136838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.137124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.137395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.138244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:49.138553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.140083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.162254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 234/469] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:49.163117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.212724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.242093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 236/470] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:49.243027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.279347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d9cb-4384-48f5-a364-b80541d6a9af None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.297398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.325759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.326739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.327715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.328094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.374109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a0a00-50d8-46ae-939d-dd1025735d6f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.416481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.417375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.418137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.418275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.418576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.418912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.464892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.516699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.519338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.538287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 235/471] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:49.539422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.607709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.647695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5bbb5-d834-4954-92ed-56c415c4e87c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.655876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 237/472] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:49.656808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.699561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.700519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.700866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.701247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.716883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.718697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.722036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:49.736152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:49.737080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:49.737911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:49.737911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.737911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:49.737911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 236/473] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:49.738527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.783096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc5945-d08c-4cfc-b805-0ba0810a6fda None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.821054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.821619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.821890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.822412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.824202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:49.839025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.840501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:49.856800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:49.857719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:49.858550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:49.858550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.858550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:49.863349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 238/474] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:49.867168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.882817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22ff4b-1324-44c2-aab1-5c5e75f161e5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:49.925734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:49.926728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:49.927195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:49.927704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:49.938487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:49.940891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:49.956510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:49.957424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:49.958257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:49.958257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:49.958257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:49.965070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 237/475] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:49.966252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:49.992516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77affaa9-b72c-43c8-8868-0f213107aaeb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.019002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.035659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.036686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.036957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.037229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.038146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.038451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.039859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.055375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 239/476] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.056406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.077998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc89ee-dd1c-437e-8302-66787f2ebfa8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.114783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.121503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.122207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.122553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.122896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.124150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.124522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.127054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.144386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 238/477] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.147504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.181383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5009c-c5dd-4f63-b947-91fd25d42560 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.223903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.224654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.225035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.225925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.226677 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.227079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.229043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.247325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 240/478] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.247325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.257429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f441-345d-40b0-aae2-909eb096fc16 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.265585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.300186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.301003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.301368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.302164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.310728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.312821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:50.328430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:50.329323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 239/479] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:50.330190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.381779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3a54c-9b43-424b-9d09-b8926c43ae35 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.389890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.423157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.424691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.425033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.425363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.433430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.435118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:50.448373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:50.449278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:50.450538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 241/480] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:50.450990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.471527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508b8c-1a50-407f-96c7-4a61a859059b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.513345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.513965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.514233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.514492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.523371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.525665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:50.539071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:50.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 240/481] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:50.541106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.569845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.581308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04777-b229-47e9-87d8-bc26865f0333 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.620842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.622226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.622714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.623208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.624059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.624386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.625794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d6431-607f-4c67-a22c-66b0d8db3823 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.639297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 242/482] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.640474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c851d-0fc5-4784-934e-f5b86a2af5b1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.640756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c851d-0fc5-4784-934e-f5b86a2af5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.641025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c851d-0fc5-4784-934e-f5b86a2af5b1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.642998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 243/483] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:50.643710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c851d-0fc5-4784-934e-f5b86a2af5b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.654548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeae46-2534-4873-915c-a11673dc4fc7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.671718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.694553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.695208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.695519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.695773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.696462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.696867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.698239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.712099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 241/484] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.712748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.760220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c851d-0fc5-4784-934e-f5b86a2af5b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.795520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.796127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.796403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.796672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.797362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.797668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.799310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddf40e-dd04-49be-ac55-24011d91fc8b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.811046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:50.817068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 244/485] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.817068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.817068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.817068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.833642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52c590-195b-49ba-b548-2b79242a7208 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:50.834485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:50.835764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:50.870631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:50.871390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:50.871789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:50.872140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:50.872973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=00b73010bdce438b846bd93f8a511634) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:50.873394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:50.874950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:50.891318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 242/486] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/role_assignments?user.id=00b73010bdce438b846bd93f8a511634&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:50.891318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.917900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 245/487] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:50.919088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:50.983722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:51.108626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd35a-0d62-4d14-94e8-f13b760f42ea None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:51.121694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7263c-0f12-45d3-9c09-8328073b99ed None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:51.167616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:51.168224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.168497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.168759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.169482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=fdb70aefb254402ea472c80b81124cfc) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:51.169783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:51.171189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:51.179056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:51.179411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 246/488] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/role_assignments?user.id=fdb70aefb254402ea472c80b81124cfc&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:51.179655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.179927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.180188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.180900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=adb92f3a165d47daa47b9de4707b1792) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:51.181205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:51.182639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ccec2-504b-4512-b1c4-7e6788c8756e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:51.191329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 243/489] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:50 2022] GET /identity/v3/role_assignments?user.id=adb92f3a165d47daa47b9de4707b1792&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:51.270170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:51.367495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa32f0-5c03-4e23-9836-cd5d487a45a2 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.367675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa32f0-5c03-4e23-9836-cd5d487a45a2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.367955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa32f0-5c03-4e23-9836-cd5d487a45a2 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.369666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 244/490] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:51.374951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:51.377545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.377545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.377787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.403107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54105d20-18d6-4a18-a05f-ec20d1e35a46 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:51.408928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:51.410329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:51.429359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:51.442953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:51.443618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.443899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.444288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.455819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:51.461521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:51.462556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:51.463536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 247/491] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:51.469103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:51.500512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 245/492] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:51.596393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd030c6-6428-4e61-9fc1-0f709ac08042 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:51.638989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:51.639608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.639927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.640236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.640933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:51.641286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:51.643651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:51.653159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 248/493] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:42:51.659442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:51.817574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e1784-d96d-400a-98ea-39ed1b8993ba None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:51.859453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:51.860087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:51.860364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:51.860633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:51.870928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:51.872413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:51.874970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:51.891471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:51.893313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:51.894430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:51.894430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:51.894430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:51.896513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 246/494] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:51.902293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:51.919619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:51.950097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.079451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb6bc5-efb6-41b1-9573-3c3bc8fdd657 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.152986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1566-99b9-48c7-a65b-59f69765b569 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.155845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.156493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.156802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.157074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.157802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:52.158326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:52.160192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:52.178649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 249/495] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:52.183753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.230263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.230901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.231177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.231472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.256442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:52.261815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:52.262698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:52.263605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 247/496] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:52.270354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.307911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:52.355440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6e0e9-5d3e-4618-a56e-db5e37c2251d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.399660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.400357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.400668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.400974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.410420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:52.412423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:52.424732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:52.425980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:52.427986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:52.430016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 250/497] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:52.433688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.523665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715c3a9-311d-48a0-8e33-ae8e67647fdb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.553940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856b43-e02d-4d4e-955d-1e310d5e245b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.582632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:52.599778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.600460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.600743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.601015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.601778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:52.602083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:52.603644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:52.606558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.607167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.607499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.607801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.608599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:52.609081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:52.610602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:52.617676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 248/498] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:52.622873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.632778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 251/499] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:52.644400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.804872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5e1e-23ea-4b8b-b378-a480daefaf25 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.811564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe336db8-3908-4044-ad8c-f63192f096b4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:52.840385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:52.875897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.877023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.877301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.877647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.878833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:52.879475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:52.879793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:52.880060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:52.898841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:52.900862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:52.928350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:52.929813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:52.930684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:52.930684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:52.930684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:52.935287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 249/500] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:52.935287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:52.978866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.005962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.007445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.125943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426611d-6b60-48c9-afaa-cd88afc75ca7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.173877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.174483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.174758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.175023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.175702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:53.176004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.177366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.191820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 252/501] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 17:42:53.201746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 250/502] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:53.202768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.207646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.261310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.351355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.363267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2edf6-a882-44cf-801e-fef30ba0dc4e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.387556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400b0aa-dc77-44d8-90cc-1da013b459fc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.429418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.430048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.430329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.430596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.441502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.442969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.455162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.455822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.456100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.456369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:53.464017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:53.464945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:53.465861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 251/503] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:42:53.477787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.477947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.479329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:53.495172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:53.496147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:53.497101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:53.497101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:53.497101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:53.497101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 253/504] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:53.502199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.609572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc6a01-f4c4-4440-8c00-ee98d74aa31a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.643093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.647346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.648096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.648477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.648849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.649610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:53.650014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.651527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.665767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 254/505] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:53.671468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.721870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.732015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe074b-e4da-47e6-afa3-c2f5f6cbaca4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.773430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.774161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.774441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.774710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.775504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:53.775812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.777427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be689218-fcf5-44c8-8074-7407a2846a46 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.789251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69919627-e053-44bd-b51c-6e7dd417f08d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.798457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 252/506] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:53.800077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780bfa5-b1a7-4cae-8ed6-20d88a09f716 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.800425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780bfa5-b1a7-4cae-8ed6-20d88a09f716 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.800698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780bfa5-b1a7-4cae-8ed6-20d88a09f716 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.806537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 253/507] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:53.807483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780bfa5-b1a7-4cae-8ed6-20d88a09f716 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.834278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.834916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.835193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.835659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.844225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.845900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-5b55c57b-f118-4617-b5bc-2ad4abafbf2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:53.857592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:53.858538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:53.859457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:53.863415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 255/508] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:53.864879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00697f-be3f-426f-b20c-77c6a250d949 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.865258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00697f-be3f-426f-b20c-77c6a250d949 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.865596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00697f-be3f-426f-b20c-77c6a250d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.885945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bb00697f-be3f-426f-b20c-77c6a250d949 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:53.887147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bb00697f-be3f-426f-b20c-77c6a250d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:53.920199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780bfa5-b1a7-4cae-8ed6-20d88a09f716 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:53.936109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.954514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:53.955437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.955720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.955993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.957191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 256/509] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:53.958971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42bb0-ba20-4526-9356-a1a8cd8851f6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.959258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42bb0-ba20-4526-9356-a1a8cd8851f6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.959556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed42bb0-ba20-4526-9356-a1a8cd8851f6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.961195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 257/510] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:53.961833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42bb0-ba20-4526-9356-a1a8cd8851f6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:53.968935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:53.970413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:53.981051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c08e596e-36ca-4fe7-b45c-1b4514f0be35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:53.989375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:53.990525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:53.991667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:53.991667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:53.991667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:53.996490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 254/511] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:53.997710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1356b-5a08-4b5f-9bec-88e93eba46d1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:53.998040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1356b-5a08-4b5f-9bec-88e93eba46d1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:53.998314 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1356b-5a08-4b5f-9bec-88e93eba46d1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:53.999935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 255/512] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:54.002184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.002459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.002723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.020838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:54.022030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:54.088451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed42bb0-ba20-4526-9356-a1a8cd8851f6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.092147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 256/513] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:54.096236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.137593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.138811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.139714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.140443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.142213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:54.142721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.144477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbcf33-d78c-45ac-81a9-3dbc29d109ac None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.160523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 258/514] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:54.162260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.162991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.163485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.190766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:54.193130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:54.211517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1296-57ed-486c-8fb3-d98696700481 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.240958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.241686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.248698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.249310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.249589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.249860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.250499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:54.250814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.252899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.265226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 257/515] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:54.266074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.281957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 259/516] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:54.283484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.383086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0ead5-cc76-4707-84ed-368f6b520326 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.400097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc17a9-5bd9-45df-a2d8-00870e044ab2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.419796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.420514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.420830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.421066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.421787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=565161def47f4b29a23f10fce8783d2b) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:54.422096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.424228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.430850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 258/517] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/role_assignments?user.id=565161def47f4b29a23f10fce8783d2b&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:54.431666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.437229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.438004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.438411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.438827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.452260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.454134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:54.476597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:54.477653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:54.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:54.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:54.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 260/518] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:54.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.517625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.519743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.584967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa87ba7-d117-47fc-a6c6-243f4239b048 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.620540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb0709-b20a-4106-81a9-0cdde98e0536 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.627299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.627937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.629230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.629230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.638054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.639584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:54.652413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:54.653309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 259/519] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:54.654840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.663618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.664340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.664638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.664906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] PATH_INFO: `/v3/services/network` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.666605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.667108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:54.682450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:54.684337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:42:54.685206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.687562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 261/520] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:54.690662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.779963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a830f9-0820-48df-a0e4-97a9a10af4fc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.786423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.795411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:54.801920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404c066-c48c-42dd-a289-854395e87a3a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.819832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.820543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.820816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.821077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.821719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:54.822004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.823380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.836175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 260/521] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:54.836972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.842753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.843537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.843818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.844865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.844865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.846075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:54.855243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:54.856225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:54.857072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 262/522] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:54.857848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:54.956570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ec31-0c2d-47d7-8eeb-4980f55d9cf8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.973457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff0bab-bca4-4d50-9935-d7e779b99e14 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:54.991524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:54.992284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:54.992650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:54.993040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:54.993809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:54.994210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:54.995727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.009057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 261/523] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:55.010118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:55.018319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.019661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.020135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.020573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.021822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:55.022296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.024517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.029954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 263/524] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:42:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:55.031050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:55.045569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:55.054696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:55.118783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd098-2de0-4ac8-9a30-2cb1c7cd3d02 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:55.145345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be898c8-9ed4-4f43-ad36-09717f3df231 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:55.156942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.158327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.158815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.159146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.160246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.162164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.181435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.182409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.182690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.182955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.183771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:55.184071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.185446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.195905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 262/525] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:42:55 2022] POST /identity/v3/users => generated 254 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:55.195905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:55.205403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 264/526] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:42:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:55.206505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:55.316107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:55.318574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:55.334177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04163-bc96-47f4-a79e-89d7aeeadb12 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:55.346121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cda29-c84f-4414-a4e3-05482098c0c3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:55.386206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.386855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.387134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.387450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.389376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=fa4114e2020f4135bb6220c7e3aedc5c, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.392580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc714cd9-fbcd-4a08-8b4b-3a663f95be5c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.396208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.396853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.397239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.397598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.398111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:55.398406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.399825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.406897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 265/527] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:42:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:55.407685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:55.411376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 263/528] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:42:55 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:42:55.586973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a434-0ddc-4c50-9aa8-f65a355791e6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:55.630857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:55.632308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:55.632800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:55.633279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:55.633962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:55.634264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:55.635767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e785-a7aa-4ad8-9c6c-4e00a0397eb0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:55.640922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 266/529] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:42:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:56.765896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010516-b040-4635-968c-1bb259dfb046 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:56.766429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010516-b040-4635-968c-1bb259dfb046 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:56.766429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c010516-b040-4635-968c-1bb259dfb046 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:56.768702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 264/530] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:56.773839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:56.774256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:56.774431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:56.804599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:56.805774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:56.807809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:56.924400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:57.329308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010516-b040-4635-968c-1bb259dfb046 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:57.468925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c010516-b040-4635-968c-1bb259dfb046 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:57.515994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:57.516641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:57.517008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:57.517368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:57.528338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:57.533716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:57.534623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:57.535885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 265/532] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:57.542953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:57.697462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fcb0b-4b67-4a38-a7fd-f23b88dceba3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:57.747969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:57.748581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:57.748862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:57.749133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:57.749794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:57.750099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:57.751521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:57.759608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:57.763395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 268/533] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:57.769703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:57.790085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:57.926056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784896-109c-4262-b88f-21a42e6bf904 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:57.977527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:57.978168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:57.978442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:57.978704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:57.990050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:57.991526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c05305c9-80b1-43ed-8f76-23289bafa719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:58.015800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:58.018981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:58.021319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:58.021319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:58.021319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:58.021319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 266/534] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:58.027488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.171495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890bcc-9574-4e36-a928-8474666fd864 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.171850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890bcc-9574-4e36-a928-8474666fd864 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.172010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890bcc-9574-4e36-a928-8474666fd864 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.173872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 267/535] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:42:58.185838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983d52-3b2e-4532-9158-b5d4f263c11b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.185838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983d52-3b2e-4532-9158-b5d4f263c11b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.185838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983d52-3b2e-4532-9158-b5d4f263c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.190098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fffd2-37b8-4d04-baf2-67ed314a3e05 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:58.215101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-55983d52-3b2e-4532-9158-b5d4f263c11b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:58.216745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-55983d52-3b2e-4532-9158-b5d4f263c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:58.266853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:58.267953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.268692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.269814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.270896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:58.272136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:58.273873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce9116-b05e-4b2d-a50a-b97566113204 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:58.297319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 269/536] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:58.299220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041e790-bd6f-4d81-8d43-83032f7a24fd None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.299720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041e790-bd6f-4d81-8d43-83032f7a24fd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.300146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041e790-bd6f-4d81-8d43-83032f7a24fd None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.305950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 270/537] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:58.305950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041e790-bd6f-4d81-8d43-83032f7a24fd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.321694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:58.343313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 268/538] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:58.343313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77ed1-8d7d-4984-b2ef-5c9ef323fbd7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.343313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77ed1-8d7d-4984-b2ef-5c9ef323fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.343313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc77ed1-8d7d-4984-b2ef-5c9ef323fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.382729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-abc77ed1-8d7d-4984-b2ef-5c9ef323fbd7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:58.383945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-abc77ed1-8d7d-4984-b2ef-5c9ef323fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:58.417526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:58.480088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 269/539] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:58.487430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7ef0-6310-4b37-9600-d0f960871dbc None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.487430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7ef0-6310-4b37-9600-d0f960871dbc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.487430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7ef0-6310-4b37-9600-d0f960871dbc None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.487430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 270/540] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:58.488783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6a9a-b358-4aeb-b25e-60bf4a4ce76a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.489060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6a9a-b358-4aeb-b25e-60bf4a4ce76a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.489506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6a9a-b358-4aeb-b25e-60bf4a4ce76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.492401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041e790-bd6f-4d81-8d43-83032f7a24fd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:58.507989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-094c6a9a-b358-4aeb-b25e-60bf4a4ce76a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:58.509161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-094c6a9a-b358-4aeb-b25e-60bf4a4ce76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:58.534688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:58.535784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.536373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.536988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.545392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:58.546942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-78837e33-a827-4d26-807e-d3941b2eabad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:42:58.562422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:58.563460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:58.565089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 271/541] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:58.565672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a750d-8af5-4216-8097-eada1514e726 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.566383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a750d-8af5-4216-8097-eada1514e726 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.566785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a750d-8af5-4216-8097-eada1514e726 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.568717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 272/542] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:42:58.572999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a750d-8af5-4216-8097-eada1514e726 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.597040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 271/543] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 17:42:58.598113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.598390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.598654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.628369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:42:58.629655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:42:58.704154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a750d-8af5-4216-8097-eada1514e726 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:58.714319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:58.730755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:58.746334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 272/544] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 17:42:58.751964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:58.751964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.751964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.751964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.752283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:58.752283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:58.753558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.753668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:58.792423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:58.797574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.876644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cefb26-0c86-493b-8a9c-6b9459481574 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:58.904327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1d0e-a037-4448-b337-3b63fe6b3321 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:58.920460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:58.921073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.921356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.921628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.922274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:58.923700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:58.947305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 273/546] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:42:58 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:58.947305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:58.969577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:58.970350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:58.970725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:58.971152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:58.983873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:58.989059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:58.990004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:58.990849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 274/547] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:58.991950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.013407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.033358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.088993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbadf6-7db1-452d-9b79-b5915b5a70cb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.110082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0eca6-3356-435b-9eb4-ef2b1e5bc689 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.128281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.128916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.129190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.129457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.140119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.141564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.154385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.155012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.155312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.155576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:59.156679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:59.158356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:59.159415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:59.159415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.159415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:59.159415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 274/548] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:59.160080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.168512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:42:59.173363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:59.174501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 275/549] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:59.175523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.258868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.269326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc95bd-b50b-4318-80fb-466a2073330d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.281182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.289330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b1912-d5dd-4908-a323-cdab09ec2bee None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.305707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.306317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.306596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.306866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.307576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:59.307880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.309238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.318074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 275/550] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:59.318868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.339091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.339740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.340012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.340279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.340924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.342283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.357756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 276/551] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:42:59 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:42:59.358592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.472937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46fbad-4e7b-4418-b417-bff017e16cd3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.492197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3a1f5-a7dc-4a60-b23e-b65b00d4ce6c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.522064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.523081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.523448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.524278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.525298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:59.525603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.527740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.536778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.537540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.537879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.538221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.539787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:59.540161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.542513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.544822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 276/552] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:59.545684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.557457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 277/553] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:59.558358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.572459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.580706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.674798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599ccd-b57e-4cb6-b018-cb0e0601d946 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.691619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a1c87-736b-4604-9683-046b106c7ba9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.724397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.725250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.725525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.725789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.735523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.736493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.736974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.737464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.739031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.741147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.745407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.747140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:59.757987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:59.758970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:59.759905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:59.759905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.759905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:42:59.762551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:59.763636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:42:59.764545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:42:59.765011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 277/554] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:59.765011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.772102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 278/555] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:59.772370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.849690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.857841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:42:59.894758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138d0db-5a16-444f-b85c-18e541988db4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.901090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1529-9985-488f-ae79-6ffc36954fce None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:42:59.934181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.934963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.935345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.935686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.936391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:42:59.936757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.938370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.944075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:42:59.944806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:42:59.945149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:42:59.945485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:42:59.952336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 279/556] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:42:59.953172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:42:59.964377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:42:59.966517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:42:59.982151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:42:59.983132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:42:59.984040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:42:59.984040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:42:59.984040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:42:59.988261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 278/557] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:42:59.989118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.072442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e1c0-b480-48b6-b794-f26533939496 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.092483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b8b8c-412a-49f6-b28d-c88dad2b06ae None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.107239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.113551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.113741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.114287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.114672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.115024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.115907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:00.116271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.117768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.130997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.131949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.132445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.132648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 280/558] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:00.133093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.133582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.141595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.143828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:00.155616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:00.156557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:00.157568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:00.160191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 279/559] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:42:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:00.161141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.269295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a708e6-f4df-4fa1-a569-1d8ccd1e5695 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.288193 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636bd8-1e46-47ec-9e3c-14fd1ea254d5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.309283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.310412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.310689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.311229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.311898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:00.312452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.314678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.324120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.324782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.325064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.325345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/565161def47f4b29a23f10fce8783d2b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.327643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=565161def47f4b29a23f10fce8783d2b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.329077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.329679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 281/560] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:00.330546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.348032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 280/561] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:00 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/565161def47f4b29a23f10fce8783d2b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:43:00.349483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.394220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.409138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.454821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e16cc-4afa-40a7-b634-05fe741d632f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.492311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c219d-51e2-444a-9baf-98e61821e044 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.499568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.500248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.501283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.501669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.502494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:00.502805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.504859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.528036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 282/562] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:00.539941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.542227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.543141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.543580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.543989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.554758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.557225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:00.572864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:00.574100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:00.575246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:00.577635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 281/563] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:00.584643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.727407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb8ff-fa3c-45f0-92ee-e328257ba003 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.740175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.745367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca67af-bba9-42b1-a526-d625830349b2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:00.748095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:00.793156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.794078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.794539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.794987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.811505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:00.812420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:00.812905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:00.813353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:00.814312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:00.814800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.816461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:00.844862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 282/564] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:00.850871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:00.899969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:00.901620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.053633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 283/565] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:01.059129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.066060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac7db-8ff5-4ab0-a1e8-cb5e306a3a3b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.083660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.111701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.112962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.113468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.113959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.125369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.127847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:01.144977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:01.145997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:01.146923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:01.146923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:01.146923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:01.149213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 283/566] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:01.154453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.179135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.283165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb5073-d2ec-4a38-9714-929b6b255f24 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.297366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabd33-6d98-4c4c-b6a6-b14ed877f6a0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.320268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.320821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.321094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.321360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.332200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.333643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.338498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.339362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.339789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.340231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.341018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:01.341997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.344060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51775b-1312-4f55-aa4b-c9ca6a284eb6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-53f6f65b-4d3a-4a27-8f10-3a8452f040af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:01.350100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:01.351378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:01.352588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:01.352588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:01.352588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:01.355940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 284/567] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:01.357106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749cdce-0ab7-4cd7-ac41-bd0149eeaf9e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.357384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749cdce-0ab7-4cd7-ac41-bd0149eeaf9e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.357653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749cdce-0ab7-4cd7-ac41-bd0149eeaf9e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.359599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 285/568] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:01.362949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 284/569] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:01.364192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749cdce-0ab7-4cd7-ac41-bd0149eeaf9e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.366342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.366626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.367386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.395751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:01.397255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:01.447521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.468131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.480802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 285/570] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:01.482120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.499071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749cdce-0ab7-4cd7-ac41-bd0149eeaf9e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.542898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.543540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.543820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.544096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.547298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:01.547298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.547298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.564999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 286/571] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:01.568328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.675976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649de17-eaa0-404b-8f25-7fe8b713cfee None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.753005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.753985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.754480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.755001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.770438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.772790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b56f7d-e425-4731-a6fe-9331c2a66671 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.774462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:01.805043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:01.806066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:01.806931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 286/572] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:01.811957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.819347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.835302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.836617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.837104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.837603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.846916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.848882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:01.863695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:01.864658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:01.865539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:01.868813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 287/573] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:01.869852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:01.895715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:01.942205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0a0b5-2f2c-4fa6-9829-bb124cf14829 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.978499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:01.979133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:01.979378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:01.979644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:01.980325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:01.980626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:01.982056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:01.987791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd489e-06f2-46ef-bcc3-98eb7098d008 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:01.999842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 287/574] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:01.999842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.029641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.030356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.030708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.031060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] PATH_INFO: `/v3/services/network` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.031779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.033770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6e6d219f-caaf-421d-8691-5323d6d1096c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:02.042756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:02.044029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:02.045058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:02.046008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 288/575] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:02.047386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9929a-3440-4f51-a8d1-5c34bc9e7315 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.047672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9929a-3440-4f51-a8d1-5c34bc9e7315 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.048572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9929a-3440-4f51-a8d1-5c34bc9e7315 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.050021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 289/576] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:02.050715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9929a-3440-4f51-a8d1-5c34bc9e7315 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.103503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.109041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff7ef-2cfb-4686-9396-95ac1942d4fc None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.130956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.146818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.147572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.147935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.148269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.149128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:02.149495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.151092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9a42-4de3-451a-9ef6-50f09ce09496 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.159582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9929a-3440-4f51-a8d1-5c34bc9e7315 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.168428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 288/577] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:02.168428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.168428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.168428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.184176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:02.185538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:02.197346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.198016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.198359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.198697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/2ab6855876ed4c90944d2545f8682e4b/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.214959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=2ab6855876ed4c90944d2545f8682e4b, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.216497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.239319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 290/578] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:02 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/2ab6855876ed4c90944d2545f8682e4b/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:43:02.239319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.275492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 289/579] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:02.276613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.396152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.409562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9891-2023-49d4-a369-5abe6090ff04 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.471751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.471950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.472300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.472638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.473415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:02.473774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.475606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.481617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 291/580] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:02.487269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.488930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2fbb-3ffb-4ee9-a720-3fcf79f884fc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.504289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.538600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.539534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.540017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.540504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.541413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=fa4114e2020f4135bb6220c7e3aedc5c) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:02.541911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.543565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.550792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 290/581] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/role_assignments?user.id=fa4114e2020f4135bb6220c7e3aedc5c&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:02.567580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.657493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce98fc-60eb-4111-9396-8e984200ad2e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.718138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.718949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.719374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.720430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.721172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:02.721571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.723271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.729564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 292/582] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:02.739147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.764700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b232a-6068-4815-bf39-54338406b553 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.772831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.809362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.809996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.810269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.811071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.811687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.813049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:02.832538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:02.833651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:02.834555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 291/583] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:02.840278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.879289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0db3-c08b-4c41-8bcd-8a2478d01dd3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:02.908385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:02.927346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:02.927346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.927346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.927346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.928048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] RBAC: Adding query filter params (interface=public, service_id=a70274618e60446a89ac76665a2e4942, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:02.928048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:02.929199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c745a33-69ef-493e-9d53-a6af997e77f2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:02.942855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 293/584] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/endpoints?service_id=a70274618e60446a89ac76665a2e4942&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:02.942855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049e09-cdae-4b87-9219-32c29e80f991 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:02.942855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049e09-cdae-4b87-9219-32c29e80f991 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:02.942855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28049e09-cdae-4b87-9219-32c29e80f991 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:02.942855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 294/585] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:02.943845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049e09-cdae-4b87-9219-32c29e80f991 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:02.995111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee8e5-8d4b-4b13-9b0d-ee3d5b515820 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.034513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.035530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.036005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.036462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.037287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:03.037778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.039369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f848-e7a4-418f-b3d9-de9166a84ab5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.044813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 292/586] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.046208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.046702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.047204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.066815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:03.070572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:03.072808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:03.083049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28049e09-cdae-4b87-9219-32c29e80f991 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.128356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.129853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.130333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.130863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.131711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.133420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.147808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 295/587] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:02 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.151233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:03.160467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 293/588] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:03.284031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ad21-cfa6-4733-a2b2-911b81b3444e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.325490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.326506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.326986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.327477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.328331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:03.328833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.330437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.339402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 296/589] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.345813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:03.398760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:03.445925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:03.467129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:03.493991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b8511-7af5-4b36-8834-32233a96d156 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.536335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.536911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.537214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.537486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.538191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] RBAC: Adding query filter params (interface=public, service_id=e34114ce6d774e1a86a1b902e319b255, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:03.538496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.539918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.548654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 294/590] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/endpoints?service_id=e34114ce6d774e1a86a1b902e319b255&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.554723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:03.572719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94ec0a-92cb-4d1b-b857-447508bb07da None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.624629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.625276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.625554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.625824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.651672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:03.656933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:03.659104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:03.660031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 297/591] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:03.669104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:03.697190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:03.711746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f738c8-f009-49f8-80f1-90177e84bafd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.773894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:03.778808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.779456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.779735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.780005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.780611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.782031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.794260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 295/592] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.801230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11626-6dad-42f5-b6f3-3df697f3c39e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:03.840666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:03.841580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:03.842033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:03.842454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:03.843329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:03.843788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:03.846094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:03.856200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 298/593] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:03.863339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:04.018582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff361d5-b4ee-4c9b-bc87-719527183ebb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:04.055100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:04.055703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:04.055978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:04.056248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:04.067602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:04.069167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:04.084463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:04.085443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:04.087184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:04.087184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:04.087184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:04.087184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 296/594] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:04.092263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:04.211902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2209e-379b-41dc-aa6c-face9b035182 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:04.247943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:04.248921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:04.249423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:04.249907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:04.250763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:04.251978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:04.253393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:04.261234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:04.268671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 299/595] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:04.276367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:04.310171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:04.438169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7afddc-49ec-4cb0-bae4-303201d0ea66 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:04.483626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:04.484255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:04.484527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:04.484792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:04.493844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:04.495296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:04.507200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:04.508213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:04.509759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 297/596] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:43:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:04.520469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:04.654179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf323f0-248d-4cfc-83ff-e4d653c8e097 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:04.698422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:04.699047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:04.699347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:04.699670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:04.700418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:04.700724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:04.702167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5ad20-5ad8-4105-bbd5-cb912993b7c2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:04.730539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 300/597] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Oct 14 17:43:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:04.731826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:04.864873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:04.907844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed921b-41b1-4276-9338-991648044f17 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:04.949170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:04.950165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:04.950654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:04.951115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.003781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d1b-ab93-4d9c-af10-3848e7252ec5 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.004119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d1b-ab93-4d9c-af10-3848e7252ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.004284 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d1b-ab93-4d9c-af10-3848e7252ec5 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.005878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 301/598] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:05.010813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.011090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.011396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.029800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:05.030529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:05.031749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:05.032108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58d2d1-3c67-4e69-b761-fb2ee8a650b2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:05.129243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:05.153652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:05.165518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 302/599] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:05.218901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 298/600] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:05.224377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.359024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceaf83f-3554-481c-be0b-15549f9495b1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:05.370725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4453-64cf-4b9a-a394-f036ddc45013 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.371238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4453-64cf-4b9a-a394-f036ddc45013 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.371368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb4453-64cf-4b9a-a394-f036ddc45013 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.372995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 299/601] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:05.378070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.378349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.378618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.395680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:05.396311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.396588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.396858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.397093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:05.398274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:05.407801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:05.409374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:05.425007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:05.425958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:05.426991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:05.426991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:05.426991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:05.426991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 303/602] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:05.431661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.511695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:05.531738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 300/603] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:05.545253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.625547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5366a93-a205-4163-a51b-38a1fbc2a9eb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:05.705328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:05.705933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.706205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.706470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.707116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:05.707459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:05.708809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:05.721307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3b25-0866-4089-b4ab-303e25125a87 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:05.722944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:05.734134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 304/604] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:05.738088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.791960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:05.792646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.792977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.793243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.811122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:05.816876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:05.817819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:43:05.818670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:05.827750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 301/605] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:05.833139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.837724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:05.841560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934a70c-9d21-450c-95a5-1ad014777f59 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:05.879897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:05.880517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:05.880791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:05.881165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:05.888171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:05.889658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:05.902669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:05.903678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 305/606] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:05.904555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:05.967903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6d8c-6ce9-45a0-bca5-8e82ac6dd11f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.018971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.019854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.020544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.020948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.021762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.022067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.022872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004003-85e0-489a-b47f-52d0dd81eec2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.023463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.033685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 302/607] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:06.034505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.066463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.067131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.067437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.067693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.068310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.069817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.071188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:06.079547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:06.080650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:06.081563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 306/608] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Oct 14 17:43:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:06.082364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.108548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.160578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364dd7f-8483-4f6a-9521-9a05d595d508 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.190788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2635fd-ded9-41c7-b27d-1930b8c5810b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.197267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.198121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.198643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.199124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.199938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.200246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.201669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d2755-371d-4c11-b868-67010b50faed None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 303/609] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47e4ac-7513-4dc4-b01d-320b15131527 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47e4ac-7513-4dc4-b01d-320b15131527 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47e4ac-7513-4dc4-b01d-320b15131527 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 304/610] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:06.219063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47e4ac-7513-4dc4-b01d-320b15131527 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.234077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.234702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.234980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.235246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.246071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.247537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:06.262580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:06.263594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:06.264486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:06.264486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:06.264486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:06.264486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 307/611] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:06.265244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.318836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.338886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47e4ac-7513-4dc4-b01d-320b15131527 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.341485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.367191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136738-15d8-4e71-8fdc-327344c7f6e7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.381304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.381906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.382184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.382452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.383066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.383393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.384756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201ef15-724f-48a9-853b-78cd2e1ef091 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.389227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 305/612] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:06.390338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.390616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.390883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.410442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:06.411263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.411723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:06.412333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.412804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.413272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.414206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=565161def47f4b29a23f10fce8783d2b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.414707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.416424 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.424588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 308/613] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/role_assignments?user.id=565161def47f4b29a23f10fce8783d2b&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:06.425797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.507981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 306/614] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:06.509306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.553109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34f4d8-6a8a-4ccd-a146-379affa0f0d9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.591003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.591653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.591931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.592204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.592871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.593175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.595243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc24bb-e979-4c22-ba53-587362230f46 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.608653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 309/615] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:06.610019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f42f8-0ae5-4996-990e-56a25d174de4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.610366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f42f8-0ae5-4996-990e-56a25d174de4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.610644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f42f8-0ae5-4996-990e-56a25d174de4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.613375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.614404 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.615635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 310/616] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:06.616563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f42f8-0ae5-4996-990e-56a25d174de4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.649220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0386be8-e5aa-49f6-b89d-c08bb1c73cdb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.704263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.705569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.705945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.706321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.707427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:06.707832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.710257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef4bb3-83ba-44e8-b51f-d62d5dd871bb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.716963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 307/617] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:06.718709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.719101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.719840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.745706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:06.747343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:06.747896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f42f8-0ae5-4996-990e-56a25d174de4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:06.792542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:06.793170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:06.793492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:06.793763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:06.802485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:06.804106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:06.817618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:06.818615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 311/618] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:06.819592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.850771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 308/619] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:06.855333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:06.943006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:06.981376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.009048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9e7b1-0d15-4e5a-bd7e-88d4e9587bd7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.015450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcdb1e-3f42-4df8-b282-cae67ce49ce3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.056883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.057598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.057900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.058174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] PATH_INFO: `/v3/services/network` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.058865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.059615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.060262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.060666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.061150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.061618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.062656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:07.063208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.065378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:07.071010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:07.072036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.072893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 312/620] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:07.079250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.097882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 309/621] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Oct 14 17:43:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:07.104250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.195652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05d457-f047-48dc-a6a7-d134199e257a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.223658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.238696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.239903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.240186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.240523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.241432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] RBAC: Adding query filter params (name=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:07.241735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.243488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.253955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 313/622] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:07.254860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.277637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f77d7f-9e7f-40fd-9e15-0aae152c8a31 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.315900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.325126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.325751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.326325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.326600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.374570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d30f-cfb0-422f-9d74-ec7403e11c45 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.412025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.413839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.414675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.415325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.415602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.415867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.416713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.418976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:07.430139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:07.431332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.432172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 314/623] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:07.432972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.497494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.550810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf56320-54da-4488-b03a-a209646d467e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.554723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 310/624] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:07.555670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.591553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.595721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.596447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.596792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.597130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.598520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:07.598888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.600456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.606117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 315/625] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:07.606992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.675771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614f62a-c9a3-4a3e-88de-05b482c7fd9d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.723106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.723576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bdeff-a43d-4b28-b835-adb4837c96b8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.724184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.724620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.725033 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.726085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:07.727451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.728977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.736164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 311/626] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:07.737220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.750696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.775582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.776315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.776849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.777170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.791356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.792805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:07.809603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:07.810636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:07.811573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:07.811573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:07.811573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:07.811573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 316/627] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:07.812231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:07.849008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:07.857965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad8f0c-7a5d-42ad-8ee5-bbcf7a413004 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.895499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:07.896453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:07.896935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:07.897425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:07.898281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:07.900240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:07.927999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bc6a9-b4bd-4f1c-bb06-1d25da4bc383 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:07.928477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 312/628] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:07.929581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:08.034201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.035234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.035744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.036233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.037074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:08.037593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.041504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.055393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 317/629] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:08.061382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:08.113794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:08.157027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b5d8f-2eba-4b7e-8182-27f497055565 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:08.200945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.202693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.202693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.202693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.202693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:08.202997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.205072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.219149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 313/630] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:08.222743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7b18-f739-46e1-84b6-8763e80384e1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:08.228305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:08.247208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:08.286974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.288361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.288845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.289312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.290744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.292845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.323510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 318/631] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:08.365109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063df126-ee6c-4684-8dd4-d0a4580a7afd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:08.413917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.414578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.414870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.415139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.423846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.425321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:08.437875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:08.439124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:08.440247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 314/632] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:08.445766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:08.536508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:08.558014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70bbed-1c40-4abd-bae4-b654dc170cde None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:08.593403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.594005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.594278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.594542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.595953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:08.596326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.597862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20621521-afdb-4ba3-a5cb-cb16265c71a9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.611358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 319/633] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:08.617341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:08.690277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:08.734411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91962d-f815-4948-83ae-8565273190cf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:08.770206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:08.770811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.771085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.771374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.772095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=2ab6855876ed4c90944d2545f8682e4b) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:08.772396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:08.773842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6048e7-340c-4023-80c0-1291b13125c5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:08.781012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 315/634] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:08 2022] GET /identity/v3/role_assignments?user.id=2ab6855876ed4c90944d2545f8682e4b&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:08.912809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc00b-b0c3-474a-962b-203b2394daee None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.913440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc00b-b0c3-474a-962b-203b2394daee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.913942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc00b-b0c3-474a-962b-203b2394daee None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.915852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 320/635] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:08.921716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6e6d-b8ae-48f0-a44d-d84deda657c2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:08.921993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6e6d-b8ae-48f0-a44d-d84deda657c2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:08.922266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6e6d-b8ae-48f0-a44d-d84deda657c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:08.942332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-908f6e6d-b8ae-48f0-a44d-d84deda657c2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:08.943568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-908f6e6d-b8ae-48f0-a44d-d84deda657c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:09.018576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 316/636] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:09.163906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43ba6-3400-450f-9ff9-d09d626796b3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.164513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43ba6-3400-450f-9ff9-d09d626796b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.164983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43ba6-3400-450f-9ff9-d09d626796b3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.166857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 321/637] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:09.172063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.172596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.173586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.192458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:09.194023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:09.252960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:09.271307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 317/638] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:09.317956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e43ba6-3400-450f-9ff9-d09d626796b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:09.430376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e43ba6-3400-450f-9ff9-d09d626796b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:09.465485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:09.466101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.466428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.466707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.467309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:09.468678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:09.478062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:09.479086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:09.479970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 322/639] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:09.488576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:09.552148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:09.561875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:09.602820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4870a6-8324-49a6-bdd5-e626713bd4c4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:09.642665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:09.643312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.643595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.643868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.644508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:09.644817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:09.646292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:09.651640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 318/640] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:09.656937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:09.658350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29f510-ab09-4704-b186-e6e43da33fff None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:09.700001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:09.700001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.700001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.700001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.700292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:09.700292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea615b2-fc73-4ac5-bc1b-d53e7c564fce None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:09.719372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 323/641] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:09 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:43:09.731777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:09.785450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6462da-2e7e-4591-984e-164b70f5be7f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:09.832218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:09.832840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:09.833114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:09.833378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:09.834081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:09.834381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:09.835797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2537d9-113d-4108-85f8-7ab628dcd9e1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:09.841748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 319/642] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:10.619797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc7c5-6f94-4e28-9b47-8fcf10dca63e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:10.620327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc7c5-6f94-4e28-9b47-8fcf10dca63e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:10.620639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc7c5-6f94-4e28-9b47-8fcf10dca63e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:10.622469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 324/643] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:10.628985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c301f-4c14-4b03-8227-019cba49b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:10.629440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c301f-4c14-4b03-8227-019cba49b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:10.629529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c301f-4c14-4b03-8227-019cba49b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:10.650179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1d2c301f-4c14-4b03-8227-019cba49b7b6 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:10.651853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1d2c301f-4c14-4b03-8227-019cba49b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:10.727504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 320/644] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:10.998052 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc7c5-6f94-4e28-9b47-8fcf10dca63e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.064262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4fb4-c151-40e5-837a-7ce4e4a64e77 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.064978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4fb4-c151-40e5-837a-7ce4e4a64e77 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.065475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b4fb4-c151-40e5-837a-7ce4e4a64e77 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.067247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 321/645] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:11.072419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.072915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.073378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.075049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:11.098522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:11.100381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:11.124522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc7c5-6f94-4e28-9b47-8fcf10dca63e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.154624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:11.164773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.165721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.166199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.166664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.167633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:11.169487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:11.180423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:11.181419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:11.182274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:11.183008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 325/646] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:11.187143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.191093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 322/647] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:11 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:11.294645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be05df-ce94-45ae-a2a5-c035eaf21a28 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.324524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:11.332293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.332893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.333229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.333505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.334128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:11.334427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:11.335811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:11.341046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 326/648] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:11.346620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.450521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23a45e-f61b-4abf-8cfb-a211feda0683 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.458944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.496434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.497038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.497408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.497679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.498401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:11.498703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:11.500097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:11.505448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 323/649] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:11.574399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922861-a530-4dff-8de6-7290baea1358 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.614391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.615086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.615399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.615672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.628742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:11.634080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:11.635235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:11.636303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 327/650] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:43:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:11.643916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.694801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:11.765577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6d1e1-ee8b-4da4-8dd1-037d0c4851ce None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.801703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.802311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.802589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.802859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.803551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:11.803854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:11.805216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:11.814783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 324/651] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Oct 14 17:43:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:11.820346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:11.885809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:11.937738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22c0ef-ae66-440b-9772-294df3e2d8eb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:11.974934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:11.975617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:11.975892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:11.976159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:11.989829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:11.991344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-ff344a16-893f-41ff-9570-36c895703b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:12.008144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:12.009183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:12.010093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:12.010093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:12.010093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:12.010093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 328/652] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:12.015150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.048697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb69e-536f-42df-85ae-8c5edc535da3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.049025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb69e-536f-42df-85ae-8c5edc535da3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.049244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb69e-536f-42df-85ae-8c5edc535da3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.050878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 329/653] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:12.056923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da7f0-433c-4e52-95a7-3774feae2577 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.057211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da7f0-433c-4e52-95a7-3774feae2577 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.057486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90da7f0-433c-4e52-95a7-3774feae2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.078379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f90da7f0-433c-4e52-95a7-3774feae2577 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:12.080229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f90da7f0-433c-4e52-95a7-3774feae2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:12.126243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.129675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9695f-b136-4bdb-9569-7720a7de95a6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.156048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 330/654] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:12.160739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf993d68-81bf-4f3e-84df-d2e6cfbf4272 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.161023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf993d68-81bf-4f3e-84df-d2e6cfbf4272 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.161296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf993d68-81bf-4f3e-84df-d2e6cfbf4272 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.162802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 331/655] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:12.168468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.168828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.169109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.171033 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.171929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.172439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.173405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.174245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:12.174735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.176343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.193927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:12.193927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:12.194587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 325/656] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:12.195663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.227198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.275421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 332/657] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:12.312517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125a19f-98eb-4a71-a8b4-050919ddf381 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.349154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.350124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.350626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.351085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.358634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.360916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:12.373909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:12.374862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:12.376494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:12.379076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 326/658] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:12.385057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.427778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.461961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.509725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6140f-d1d7-4308-aa4f-57a0329503f1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.549055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.549760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.550042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.550311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.551042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:12.551376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.553504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.565232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4a2f-d2e2-4b07-af55-dee96b1ff59b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.573566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 333/659] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:12.574298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.602090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.605537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.606170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.606435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.606719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.607307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.608656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:12.617800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:12.618728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:12.619648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 327/660] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:12.620472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.694442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1c83-31ab-4be7-9280-bc87a1ca150b None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.709947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.727810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da847da-b26b-4465-90ea-7754959e79a0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.738614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.739794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.740277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.740777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.741528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.742906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.763305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 334/661] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:12 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:12.763305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.776571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.778270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.778820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.779787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.798068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.800331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:12.822789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:12.824027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:12.825107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:12.825107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:12.825107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:12.832152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 328/662] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:12.833357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.871441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:12.892308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308023b6-d886-4c80-b2f0-d6505c25f582 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.930936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:12.931745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:12.932379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:12.932379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:12.933017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:12.933325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:12.934707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:12.940827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 335/663] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:12.946920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:12.963185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bde7-3b4f-42ba-a01b-080d5d999d4f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:12.999157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:13.003327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.003937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.005098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.005975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.007093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:13.010017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.010017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.030792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 329/664] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:13.038065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:13.062088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6af03-7afb-4eeb-8b4e-0f68247db06e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.097561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.098177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.098519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.098718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.099378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:13.099685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.101048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.111699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 336/665] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:13.112714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:13.128846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:13.158206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d9ce5-3aba-411a-a4ba-f54ed2d32fdd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.197109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.198164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.198687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.199199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.207067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.208986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.217911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b7bac-6e6b-4c18-9173-64dbaceeb47d None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:13.222342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:13.223215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:13.224132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:13.231071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 330/666] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:13.232251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:13.254457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.255033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.255335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.255603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.256302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] RBAC: Adding query filter params (interface=public, service_id=b7aa2f7e83574b96857ad8f74abd7309, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:13.256802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.257971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.268371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:13 2022] GET /identity/v3/endpoints?service_id=b7aa2f7e83574b96857ad8f74abd7309&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:13.272784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:13.305109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:13.368551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585e06f-c5b7-45d2-bc16-70d25ca296d7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.374053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:13.398803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e176b-5558-4b27-9de5-45e9da4eebbc None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.409669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.410585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.411055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.411543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.412514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:13.413121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.414744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.433410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 331/668] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:13.434907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:13.438089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.438820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.439095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.439393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.440461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.441353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d28d74-90d0-4e5d-9806-4c0123be8b9a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.451730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 338/669] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:13 2022] GET /identity/v3/services => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:13.553663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681b85-68e9-4eb7-bc72-0f65b799c1b0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:13.569089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:13.595045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:13.596147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.596689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.597178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/2ab6855876ed4c90944d2545f8682e4b/roles/5ad046989ce0426d9a189a8ae44cbccb` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.599775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=2ab6855876ed4c90944d2545f8682e4b, role_id=5ad046989ce0426d9a189a8ae44cbccb)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:13.601614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661afe0c-ef21-4ab2-9412-c2f067f6d911 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:13.618647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 332/670] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:13 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/2ab6855876ed4c90944d2545f8682e4b/roles/5ad046989ce0426d9a189a8ae44cbccb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:43:13.812590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fcdb-a3ee-4882-9b41-126bcfb0cfd0 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.814298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fcdb-a3ee-4882-9b41-126bcfb0cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.814781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fcdb-a3ee-4882-9b41-126bcfb0cfd0 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.816665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 339/671] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:13.821753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cb37-c335-498a-b099-6d425d087687 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:13.822185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cb37-c335-498a-b099-6d425d087687 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:13.822387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cb37-c335-498a-b099-6d425d087687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:13.841645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-dad8cb37-c335-498a-b099-6d425d087687 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:13.842812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dad8cb37-c335-498a-b099-6d425d087687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:13.914703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 333/672] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:13 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:14.192292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806fcdb-a3ee-4882-9b41-126bcfb0cfd0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:14.298163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806fcdb-a3ee-4882-9b41-126bcfb0cfd0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:14.333210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:14.333817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:14.334089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:14.334363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:14.335025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:14.336725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c073-0928-4038-8f40-937d14c32e32 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:14.348934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:14.354478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 340/673] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:14 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:15.032990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31ebbc-155a-4b76-b7bd-7b00aea78e9e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.033496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31ebbc-155a-4b76-b7bd-7b00aea78e9e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.033574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31ebbc-155a-4b76-b7bd-7b00aea78e9e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.035140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 334/674] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:15.040407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.040874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.041068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.061225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:15.062420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:15.147999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 341/675] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:15.420167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31ebbc-155a-4b76-b7bd-7b00aea78e9e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:15.530248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31ebbc-155a-4b76-b7bd-7b00aea78e9e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:15.531760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:15.568191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:15.568823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.569157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.569428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.570007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:15.571402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:15.580648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:15.582887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:15.584877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 335/676] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:15.587999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:15.699301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762a7-e2ec-4b33-b9f5-ac3a6bef5609 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:15.720350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:15.729294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:15.730159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.730727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.731194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.732179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:15.732474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:15.733819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752d55-224f-4338-818d-4a5ddb7d1e0e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:15.739560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 342/677] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:15.744942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:15.755913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72557-c617-42a4-9211-a9f4a3414a82 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.756925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72557-c617-42a4-9211-a9f4a3414a82 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.757377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72557-c617-42a4-9211-a9f4a3414a82 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.759509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 343/678] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:15.764938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40e9a-aee3-4514-addc-2e1a065f6eb0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.765427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40e9a-aee3-4514-addc-2e1a065f6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.765874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40e9a-aee3-4514-addc-2e1a065f6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.789449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-91c40e9a-aee3-4514-addc-2e1a065f6eb0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:15.790690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-91c40e9a-aee3-4514-addc-2e1a065f6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:15.867688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c016f0-39f9-45a4-aed0-0ffda03c7ef1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:15.887315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 344/679] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:15.910424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:15.911024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.911320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.911594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.912210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:15.912505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:15.913899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5df40-5b4b-4b78-af38-6aec3c240806 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:15.914555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a4ac-c531-4225-b67e-365c4231354f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.915035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a4ac-c531-4225-b67e-365c4231354f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.915542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a4ac-c531-4225-b67e-365c4231354f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.917328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 345/680] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:15.919318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 336/681] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:15.924455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a4ac-c531-4225-b67e-365c4231354f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:15.927204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:15.927525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:15.927788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:15.946598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:15.948082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:15.977266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.032284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 337/682] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:16.039869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a4ac-c531-4225-b67e-365c4231354f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.060045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.074972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.075609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.075886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.076162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.076923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] RBAC: Adding query filter params (interface=public, service_id=ba74d8cb2e5540618d747228769a009d, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:16.077229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.078635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.085066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 346/683] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:15 2022] GET /identity/v3/endpoints?service_id=ba74d8cb2e5540618d747228769a009d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:16.090906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.179321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.198207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdee1c-f9a1-43c5-a8b9-1ef5b4c7ef9c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.236864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.237473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.237753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.238024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.238628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.240176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.247259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 338/684] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:16.298990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593755e-ebb5-478d-9261-8b887ce16ef6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.331227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.343143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.344195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.344808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.345297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.346159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.347801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:16.357698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:16.358686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 17:43:16.359623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:16.361934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.368349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 347/685] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:16.369541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.427397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.451779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f02c-3139-49d1-9436-8755538b02c8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.480714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400e66d-2442-4c6f-b25a-0a68ea814eb5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.488389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.489227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.489674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.490108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.501714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:16.507604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:16.508671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:16.509508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:16.512218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 339/686] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:16.520221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.525713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.526666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.527159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.527596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.528419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:16.528871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.530504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.540252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 348/687] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:16.546044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.624682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.643087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b32a2-04b9-48a6-9273-4255f2e269c2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.670143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05860978-705a-454a-a9ca-664bc1f3d664 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.686998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.689535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.690215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.690490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.690758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.691464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:16.691766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.693146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b4db-bfc1-41c0-bc92-378265990ee8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.706565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 340/688] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:16.706565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d7b5-627d-4e63-829c-b6562110b628 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.706565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d7b5-627d-4e63-829c-b6562110b628 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.706565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d7b5-627d-4e63-829c-b6562110b628 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.706565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 341/689] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:16.707398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d7b5-627d-4e63-829c-b6562110b628 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.722543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.723233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.723708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.724040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.724850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:16.725215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.726660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7877f-d02b-4b09-bd50-22100e892a36 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.737227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 349/690] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:16.737227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.737227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.737227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.753710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:16.754877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:16.818552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d7b5-627d-4e63-829c-b6562110b628 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.823895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 350/691] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:16.824871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.857487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.858674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.859131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.859768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:16.874060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:16.876175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:16.884517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:16.898441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:16.899554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:16.900465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:16.900465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:16.900465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:16.903524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 342/692] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:16.906444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:16.954101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a735-b87a-412c-8c03-b19a8c26acf3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:16.963801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:16.997805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:16.998887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:16.999166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:16.999464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.000417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.002365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.031440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 351/693] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:17.044847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04649ee6-8955-4342-a264-5fea8ef7930b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.092866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.094316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.094972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.095482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.096590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:17.097246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.099063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.102912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.114833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 343/694] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:17.125055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.197908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.248546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6bd1f-4604-44dd-bced-4be876d2d231 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.255405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed847-9a45-46c4-882c-2a8b089ee497 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.292692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.293324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.293599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.293862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.294505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.295904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.298477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.299420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.299701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.299967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:17.306317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:17.307391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:17.308246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 352/695] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:17.310425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.311925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.316849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:17.327832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:17.328849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:17.329930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 344/696] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:17.335265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.356387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.445691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0500-dd5c-4705-8bfc-b29143f2a138 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.476075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7745-8333-41aa-a966-d15e75a27520 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.483369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.484095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.484466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.484827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.486143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:17.486538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.488017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.495437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 353/697] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:17.498830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.500177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.527300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.528182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.528465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.528730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.529460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:17.529760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.532501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.557297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 345/698] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:17.562977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.606911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.628171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a11a5a-815c-4b3a-af99-cd22c92582f4 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.668863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.670093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.670657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.671175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.671973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:17.673107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.674746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.680557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 354/699] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:17.686028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.695827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40955cc2-95ff-4bd3-8abb-289611869604 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.745201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.745944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.746284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.746641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.802126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f54aff-f3a9-4501-a0b8-cfe6ef97f8bd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:17.802620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.834780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.836806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.846708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:17.847577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:17.847893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:17.848226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:17.849058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] RBAC: Adding query filter params (interface=public, service_id=f8d9138f46cd45f4b4bc27bae2b7fd13, region_id=RegionOne) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:17.849736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:17.851000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:17.862957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/endpoints?service_id=f8d9138f46cd45f4b4bc27bae2b7fd13&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:17.864969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.888066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:17.947860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 346/701] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:17.954127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:17.991116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84357f-8946-4938-bef0-d1996d0b725f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.030201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.031439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.031904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.032755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.033593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.035585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.047996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 356/702] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:18.055810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:18.093356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899bcae-b6e1-4803-bf67-a29dc1241170 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.135048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.136178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.136638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.137084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.149998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.151918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:18.168738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:18.169793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:18.170717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:18.170717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:18.170717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:18.173940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:18.180564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:18.275817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:18.295688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e193b-68af-446e-bfd3-1c51f3c87725 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.330545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.331067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.331367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.331633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.332269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:18.332564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.333903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a8d03-03b2-4bb6-a15d-bf0fd259b761 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.351549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:18.356468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:18.470900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd719-8e90-4928-8af8-891e340c65bf None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.476935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7526-07e2-4271-8244-3f6476cae5ab None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.477215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7526-07e2-4271-8244-3f6476cae5ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.477482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7526-07e2-4271-8244-3f6476cae5ab None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.479411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 358/705] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:18.484729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.485685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.486054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.502281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:18.507989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:18.509980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:18.515295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.516128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.516556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.517129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.524368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.525978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:18.538364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:18.539466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:18.540463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:18.542331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 348/706] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:18.549455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:18.599402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 359/707] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:18.665337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39c31-6efd-4361-907b-657f875e0a36 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.705577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.706179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.706450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.706716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.707423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:18.707723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.709151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.722580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 349/708] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:18.728550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:18.802265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:18.836231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e53239-9e41-44c6-91f0-b1dcfe3d33d5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:18.882384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:18.883311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:18.883756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:18.884174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:18.885048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] RBAC: Adding query filter params (role.id=5ad046989ce0426d9a189a8ae44cbccb, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=2ab6855876ed4c90944d2545f8682e4b) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:18.885500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:18.887054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:18.894615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 360/709] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:18 2022] GET /identity/v3/role_assignments?user.id=2ab6855876ed4c90944d2545f8682e4b&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=5ad046989ce0426d9a189a8ae44cbccb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:18.933172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:18.997443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:19.082142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2cdc-93dc-40d9-b2a7-6cf81fe5fbf5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:19.137745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:19.138657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.138657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.138902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.139339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:19.140689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:19.153039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:19.154068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:19.154897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:19.156638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 350/710] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:19.163040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:19.289613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939656-b448-4a6a-a556-93a7d484008f None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:19.335225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:19.336225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.336477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.336748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.337407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:19.337712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:19.339106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b7df6-a441-4fc1-9dbe-ab5a5c568030 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:19.341400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:19.355305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 361/711] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:19.358726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:19.451599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e028f76-c2ac-4bc5-af4e-3f6eed761ae6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.452504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e028f76-c2ac-4bc5-af4e-3f6eed761ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.452986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e028f76-c2ac-4bc5-af4e-3f6eed761ae6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.456169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 362/712] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:19.461798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.462077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.462351 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.484407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:19.486790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:19.497782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dacf90-9c88-47a1-9684-53dc5824a18e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:19.508899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:19.540682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:19.541686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.542190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.542675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.543408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:19.543778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:19.545231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:19.558260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 351/713] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:19.560069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:19.591614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 363/714] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:19.692176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cc848-caf9-4e70-8c9d-9fb1c8f0e3be None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:19.728528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:19.729054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:19.729333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:19.729602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:19.730332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:19.731734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:19.756430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 352/715] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:19.887801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:19.996700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08446544-bd32-474a-8fc8-685f58978f6a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:20.030329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:20.043016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:20.043719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.043996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.044254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.044828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:20.046169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:20.055126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:20.056174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.057010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 364/716] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:20.062408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:20.092928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:20.173204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59bba8-dcf6-43b1-a5e5-877715638bce None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:20.208952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:20.209572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.209850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.210122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.210752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:20.211328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:20.212691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cbf62-7842-4fea-b1c5-092bc449f915 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:20.218277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 353/717] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:20.224223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:20.338158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3010a7-a10f-4d21-b0e9-47306cc71750 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:20.348227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec1e-3148-40d9-bf35-8ca481ffda7e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.348899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec1e-3148-40d9-bf35-8ca481ffda7e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.349181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bec1e-3148-40d9-bf35-8ca481ffda7e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.351534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 354/718] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:20.356582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.357083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.357351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.379953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:20.380206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:20.380564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.380876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.381158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.381256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:20.381791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:20.382092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:20.383683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:20.389712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 365/719] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:20.462068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 355/720] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:20.732025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:20.790718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:20.837562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df38d69-2750-4cc0-af8d-65ab5bc38dd0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:20.871907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:20.872537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:20.872810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:20.873074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:20.873655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:20.875003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:20.884649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:20.885655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:20.886532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 366/721] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:20.892057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:20.918573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:20.998319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a9a71-ae87-4e3f-9350-eaec0daf1056 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:21.034083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:21.035069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.035576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.036066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.036962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:21.037466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:21.039031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:21.044260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 356/722] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:21.055392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:21.161421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070771-fa19-40be-b84f-eb699421a7a5 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:21.189338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:21.198870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:21.199826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.200501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.200766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.201399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:21.201692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:21.203039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1db56-7aa6-4cb7-b983-d7952ca2a4dc None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:21.208732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 367/723] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Oct 14 17:43:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:21.214499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:21.309063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:21.330220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbf59-152f-4481-9c3f-abf014187248 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:21.366751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:21.367768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.368247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.368713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.369783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:21.371501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:21.380526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12755e8-3e53-4529-80f7-4d5856442fbe None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.381034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12755e8-3e53-4529-80f7-4d5856442fbe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.381034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12755e8-3e53-4529-80f7-4d5856442fbe None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.382717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 368/724] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:21.388439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.389153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.390851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.403749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 357/725] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:21.417916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:21.419574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:21.507240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 369/726] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:21.779573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:21.884074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003daae1-ea5b-4952-9e50-b07e1a79a5fb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:21.919079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:21.919737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:21.920016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:21.920286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:21.920864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:21.922216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:21.931201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:21.932198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:21.933026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 358/727] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Oct 14 17:43:21 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:21.938475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:22.046829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1382c-a6e7-4b5b-b0c9-7d28f41a6465 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:22.056412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:22.082405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:22.083013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.083300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.083582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.084206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:22.084499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:22.085841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b841e89-db47-40b9-990c-5e669524ac3d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:22.091300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 370/728] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:22.100645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:22.110743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:22.120517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553756-8745-481b-b078-50e7eb6daed2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.120793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553756-8745-481b-b078-50e7eb6daed2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.121071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553756-8745-481b-b078-50e7eb6daed2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.122668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 371/729] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:22.128401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.128677 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.128947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.148559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:22.149852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:22.215864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fd60-fa5b-4847-bdea-aec393e6c9a7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:22.229689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 372/730] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:22.254263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:22.254866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.255139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.255443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.256067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] RBAC: Adding query filter params (type=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:22.256366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:22.257727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:22.263191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 359/731] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:22.506619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:22.615100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c54e-0154-4a25-b6fd-b40b1269ab8d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:22.616651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:22.651670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:22.652299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.652571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.652833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.653412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:22.654751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3ad42f26-76aa-4015-b0d8-30fdba2a5208 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:22.663511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:22.665803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:22.667783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 373/732] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:22.675308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:22.700819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17141a4-800c-4784-b9f5-04b179e54e28 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.701312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17141a4-800c-4784-b9f5-04b179e54e28 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.701757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17141a4-800c-4784-b9f5-04b179e54e28 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.704002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 374/733] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:22.709085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.709434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.709775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.729135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:22.730419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:22.760402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:22.800272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dfc89-6982-4248-b9fb-97890d009220 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:22.806360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 375/734] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:22.834577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:22.835181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.835517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.835798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.836671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:22.836966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:22.838313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:22.843299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 360/735] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:22.849552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:22.951811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:22.959105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4885a5-4c44-4412-87db-13d8a21ee0b3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:22.996946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:22.997549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:22.997819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:22.998078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:22.998815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:22.999110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:23.000530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:23.005785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 376/736] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:23.012442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:23.077602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:23.128455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b183b6-1fb8-47ca-9bea-88f962c05dfd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:23.171386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:23.172066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:23.172391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:23.172654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:23.173422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] RBAC: Adding query filter params (interface=admin, service_id=ba74d8cb2e5540618d747228769a009d, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:23.173746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:23.175121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:23.177008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:23.187500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 361/737] 10.222.0.26 () {56 vars in 1249 bytes} [Fri Oct 14 17:43:23 2022] GET /identity/v3/endpoints?service_id=ba74d8cb2e5540618d747228769a009d&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:23.189450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:23.197446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaa2e2-95fa-4ec6-9526-9f598c086a87 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:23.242760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:23.243800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:23.244415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:23.244881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:23.246231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:23.248022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b7b41-f696-4815-87f6-191bd1d472ad None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:23.275752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 377/738] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:23 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:43:23.315985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80214-0ddd-426c-bf07-839ee3b9cb9f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:23.364705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:23.365329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:23.365605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:23.365876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:23.366537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:23.368071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c33237-71d8-403b-a2f3-8ee9d7d2963a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:23.379957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 362/739] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:23 2022] GET /identity/v3/services => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:23.788766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577abb-6d5b-474f-bbe1-b323a1845176 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:23.789732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577abb-6d5b-474f-bbe1-b323a1845176 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:23.790201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577abb-6d5b-474f-bbe1-b323a1845176 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:23.792022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 378/740] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:23.798257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:23.798803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:23.799317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:23.817482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:23.818931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:23.875623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:23.895660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 363/741] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:24.157755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577abb-6d5b-474f-bbe1-b323a1845176 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:24.181502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:24.270587 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577abb-6d5b-474f-bbe1-b323a1845176 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:24.305644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:24.306252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:24.306529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:24.306800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:24.307486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:24.308898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:24.311510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING keystone.server.flask.common [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 14 17:43:24.330556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:24.330556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:43:24.330556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [parameters: {'id': 'b877e2c525d44f3b81088c9b0dec40b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 17:43:24.330556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6198d1f0-824b-45b2-809b-11c581e52a66 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b877e2c525d44f3b81088c9b0dec40b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b877e2c525d44f3b81088c9b0dec40b3. Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:24.338810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 17:43:24.339694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 14 17:43:24.340622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 17:43:24.341497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 17:43:24.342400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:24.343191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'id': 'b877e2c525d44f3b81088c9b0dec40b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:24.346458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:24.348397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b877e2c525d44f3b81088c9b0dec40b3. Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:24.358607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 379/742] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Oct 14 17:43:24 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:24.360476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:24.465264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f298ffc-173b-4c27-8012-3b530f4dbf46 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:24.486283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507cc0-a8e5-4b54-b8b3-80c0388f9fd2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:24.486608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507cc0-a8e5-4b54-b8b3-80c0388f9fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:24.486836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507cc0-a8e5-4b54-b8b3-80c0388f9fd2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:24.495306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 380/743] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:24.496396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:24.496682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:24.496953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:24.502059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:24.502993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:24.503552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:24.504040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:24.511569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:24.513013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:24.518310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:24.520056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:24.530583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:24.531566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:24.532673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 364/744] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:24.540716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:24.596566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:24.600098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 381/745] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:24.655362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1420c8-846a-4bbc-aad6-89db4937b54e None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:24.698886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:24.699771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:24.700219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:24.700657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:24.701538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:24.702009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:24.703661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfb333-bff6-4083-9f39-bcac5eac6476 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:24.721601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 365/746] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:24.896318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:24.904909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:25.001069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ce03-1dd6-4b1d-bdd8-f721c56fee2a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:25.036949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:25.037554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:25.037829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:25.038095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:25.038743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:25.040254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544723c-2cbf-4f7f-97d2-113460e2dd16 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:25.058066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 382/747] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:24 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:25.549353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667321d-78ca-4d5d-a305-7d7f77f5f691 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:25.549883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667321d-78ca-4d5d-a305-7d7f77f5f691 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:25.549961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667321d-78ca-4d5d-a305-7d7f77f5f691 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:25.551704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 366/748] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:25.557924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5dc1c-b100-4db7-94c1-e182a5cf1b56 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:25.558261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5dc1c-b100-4db7-94c1-e182a5cf1b56 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:25.558468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5dc1c-b100-4db7-94c1-e182a5cf1b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:25.578140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a3b5dc1c-b100-4db7-94c1-e182a5cf1b56 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:25.579921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3b5dc1c-b100-4db7-94c1-e182a5cf1b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:25.644248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:25.658798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 383/749] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:25 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:25.687130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc3f-24ae-4760-82e0-a4c8ded1d7e1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:25.688390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc3f-24ae-4760-82e0-a4c8ded1d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:25.688881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625adc3f-24ae-4760-82e0-a4c8ded1d7e1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:25.690754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 367/750] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:25.696299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:25.696587 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:25.696860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:25.716772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:25.718012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:25.789945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 384/751] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:25 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:25.944909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625adc3f-24ae-4760-82e0-a4c8ded1d7e1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.054481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625adc3f-24ae-4760-82e0-a4c8ded1d7e1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.064572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.071197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.097204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.097838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.098117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.098441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.099030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.100904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:26.112544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:26.113538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:26.114366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 368/752] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:26.120527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.192117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a878b-785b-4134-aa3c-6d96124217ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.217031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.236128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.236767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.237369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.237653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.238251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.240104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.246773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3841f5-bae7-4c1f-838c-2ff6910e2de1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:26.251970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:26.252934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:26.253756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 385/753] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:26.260305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.292368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.293249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.293537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.293810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.294430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:26.294732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.303336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.308401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 369/754] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:26.309247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.349014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.373756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59628195-6195-4e30-a146-f714bda310f2 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.411828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.412835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.413347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.413942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.414924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:26.415460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.417012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.423646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 386/755] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:26.434609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.434756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693544-c6d9-484f-a435-eec5075afaf0 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.477581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.478592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.478878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.479439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.480355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:26.480663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.482022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.486931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.495319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 370/756] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:26.498323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.559646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dd6be-e9ab-4677-89c1-dc7beab771c8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.595651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.596256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.596589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.596857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.597676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:26.597785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.599106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.609189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 387/757] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:26.610667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.612685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.616673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c49c5-9719-4767-ba74-4100db842393 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.654855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.655884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.656339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.657320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.658278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] RBAC: Adding query filter params (interface=public, service_id=de8a7122ae774b9a8bd83787e86a6140, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:26.658815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.660648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.671607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 371/758] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/endpoints?service_id=de8a7122ae774b9a8bd83787e86a6140&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:26.673518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:26.716202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4a490-45f1-4348-b911-5ee3af012b72 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.730875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:26.752913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.753626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.753971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.754668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.755035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.756568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8d6c0-df25-45da-a6ef-192794c55b6f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.783149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 388/759] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:26.801304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df492ecf-aad6-467e-be1b-052d22ab51d4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:26.849128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:26.850112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:26.850576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:26.851046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:26.851919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:26.853534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5f51-d37c-4a35-9693-01d455d4e829 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:26.862133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 372/760] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:26 2022] GET /identity/v3/services => generated 1957 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:27.054074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf80a-5208-40d6-a27d-bbcd9dc61ab4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.054401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf80a-5208-40d6-a27d-bbcd9dc61ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.054625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf80a-5208-40d6-a27d-bbcd9dc61ab4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.056266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 389/761] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:27.061554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc33ce-9e21-47fa-9608-3b8ae536360e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.062123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc33ce-9e21-47fa-9608-3b8ae536360e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.062601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc33ce-9e21-47fa-9608-3b8ae536360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.082348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-03cc33ce-9e21-47fa-9608-3b8ae536360e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:27.083899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-03cc33ce-9e21-47fa-9608-3b8ae536360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:27.104762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:27.159729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 373/762] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:27.289189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dd0a-b1e0-4471-a8aa-0fbfad060ef3 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.289708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dd0a-b1e0-4471-a8aa-0fbfad060ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.289708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dd0a-b1e0-4471-a8aa-0fbfad060ef3 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.291341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 390/763] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:27.297225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.297805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.298180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.317245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:27.318419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:27.389745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 374/764] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:27.443438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7dd0a-b1e0-4471-a8aa-0fbfad060ef3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:27.572454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7dd0a-b1e0-4471-a8aa-0fbfad060ef3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:27.615695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:27.616307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.616585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.616861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.617508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:27.618919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:27.636968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.sql.core [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 17:43:27.636968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 17:43:27.636968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [parameters: {'user_id': '89c6dfd7b8b243debd9d17a5c63d6722', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 17:43:27.636968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:27.644799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:27.645658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application yield resource Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise self.value Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application session.commit() Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 17:43:27.646581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.session.flush() Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application compat.raise_( Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 17:43:27.647469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:27.648336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:27.649150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [parameters: {'user_id': '89c6dfd7b8b243debd9d17a5c63d6722', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:27.649956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 14 17:43:27.650736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.653982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 391/765] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Oct 14 17:43:27 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:27.654860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:27.685449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:27.728521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:27.751209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:27.771086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722e4e6-f2ca-4999-86cc-d3cfedb83987 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:27.803628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a556f30-e343-4daf-a540-676bea43620c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:27.810721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:27.811897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.812173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.812444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.822164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:27.824089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:27.839648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:27.840580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:27.841521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 375/766] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:27.846311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:27.846572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:27.846951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:27.847230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:27.847533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] PATH_INFO: `/v3/services/image` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:27.848122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:27.849914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:27.862005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:27.863807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:27.864643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 392/767] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Oct 14 17:43:27 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:27.870904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:27.965748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373be07-abb8-47ea-97c6-0ef2a0799984 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:27.974238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:27.977486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c9a02-4200-4708-b728-72216a6b10af None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:28.005999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:28.006697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:28.007293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:28.007406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:28.008090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:28.008418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:28.009814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:28.016017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:28.016889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:28.017373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:28.017871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:28.018753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:28.019294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:28.020834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:28.034351 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 393/768] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:28.035529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:28.055304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 376/769] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Oct 14 17:43:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:28.155497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bf0e8-55a6-4024-85f0-119285ae8a9a None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:28.198417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:28.199484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:28.199993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:28.200477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:28.201341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] RBAC: Adding query filter params (type=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:28.201870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:28.204059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:28.210210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 394/770] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:28.216663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:28.221611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:28.326860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b945-4933-4f0a-9890-e2e305bc09c2 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:28.364916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:28.365520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:28.366085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:28.366262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:28.366923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] RBAC: Adding query filter params (interface=public, service_id=ca33d04eedc2445691f8d92a3bf4c5d7, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:28.367228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:28.368711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cab33-8809-4298-93c1-8e59054d8f02 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:28.374656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 377/771] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:43:28 2022] GET /identity/v3/endpoints?service_id=ca33d04eedc2445691f8d92a3bf4c5d7&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:28.381035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:28.415257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:28.603145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919d78-2575-4cfa-9480-09ec47c8b4ef None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:28.638271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:28.639241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:28.639760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:28.640248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:28.641191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:28.642746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861fa9d-26fe-4516-be33-72eb22fd9dba None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:28.649642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 395/772] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:43:28 2022] GET /identity/v3/services => generated 1957 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:43:29.046148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f241-3e16-4162-8fcf-67f3cc34011b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.046679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f241-3e16-4162-8fcf-67f3cc34011b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.046679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f241-3e16-4162-8fcf-67f3cc34011b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.048736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 378/773] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:29.054132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ac16-2e77-4581-8f20-0f20190199d0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.054417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ac16-2e77-4581-8f20-0f20190199d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.054688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ac16-2e77-4581-8f20-0f20190199d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.074159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-aa72ac16-2e77-4581-8f20-0f20190199d0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:29.075953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aa72ac16-2e77-4581-8f20-0f20190199d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:29.149196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 396/774] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:29.190123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a508f7-f1f3-4edc-a413-977f17e4f8fa None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.190422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a508f7-f1f3-4edc-a413-977f17e4f8fa None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.190670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a508f7-f1f3-4edc-a413-977f17e4f8fa None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.192172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 379/775] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:29.197183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.197473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.197745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.216824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:29.217996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:29.235484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:29.288617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 397/776] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:29.419521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a508f7-f1f3-4edc-a413-977f17e4f8fa None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:29.565746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:29.604086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:29.642561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a508f7-f1f3-4edc-a413-977f17e4f8fa None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:29.674681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee3a88-7af7-4f7b-a643-278eddcc4e83 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:29.679585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:29.680228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.683343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.683343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.684443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:29.686322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:29.691328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 380/777] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:29.695314 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:29.716715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:29.717348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.717623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.717891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.718474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:29.719947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:29.728527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:29.729488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:29.730312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 398/778] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:29.735468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:29.755193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:29.805495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966fff4-3b36-4b4b-b903-49f1bf2e7edd None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:29.840780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:29.841369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.841641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.841905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.842538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:29.844151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:29.845438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badcd4-c6c0-47ff-8eaf-063af134d868 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:29.848568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:29.883301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 381/779] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:29 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:29.896381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:29.897006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:29.897282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:29.897553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:29.898210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:29.898511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:29.899932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:29.905815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 399/780] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:29.912343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:30.023197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdf80-2c65-4890-b700-3c840b18f3d1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:30.060821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:30.061525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:30.061878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:30.062224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:30.063558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:30.063863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:30.065227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9012aa-5263-40e6-962d-5be365583e80 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:30.070498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 382/781] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Oct 14 17:43:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:30.076327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:30.159733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:30.180392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf10f-084f-449a-bd58-cbd8ad006063 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:30.214955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:30.215589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:30.215863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:30.216126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:30.216802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:30.218142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f5d39-83f8-4467-9866-10bd80607637 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:30.238919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 400/782] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:43:30.864815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421710-6932-41c7-a22f-62c6c9bf4bc8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:30.865183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421710-6932-41c7-a22f-62c6c9bf4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:30.865363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a421710-6932-41c7-a22f-62c6c9bf4bc8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:30.866837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 383/783] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:30.871916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:30.872375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:30.872453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:30.891515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:30.892803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:30.965787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 401/784] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:31.251615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a421710-6932-41c7-a22f-62c6c9bf4bc8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:31.305031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:31.357656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a421710-6932-41c7-a22f-62c6c9bf4bc8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:31.392203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:31.392838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:31.393113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:31.393381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] PATH_INFO: `/v3/services/image` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:31.393954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:31.395322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:31.404199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:31.405157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 17:43:31.406036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:31.410923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 384/785] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Oct 14 17:43:31 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:31.412048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:31.473307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:31.514133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8dfb-c54b-4a72-ac1b-dd9182af0260 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:31.548722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:31.549330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:31.549607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:31.549875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:31.550507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:31.550805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:31.552249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:31.557394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 402/786] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:31.563347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:31.665212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02da3-2d3e-41f0-9402-724d1892be97 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:31.678820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:31.706435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:31.707271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:31.707754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:31.708283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:31.709092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] RBAC: Adding query filter params (type=image) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:31.709604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:31.711441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51cd8-1c92-4ca5-ba79-b225967ea409 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:31.716432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 385/787] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:31.723162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:31.822621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd49093-5534-4ad2-a5a4-47157a06ded7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:31.847900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:31.857281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:31.857879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:31.858150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:31.858414 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:31.859070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:31.860571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8455c-7f33-441d-9cdd-9032ed7562ee None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:31.885675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 403/788] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:43:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:32.124423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93cb4-0cc3-41ec-9f85-3896ad63d949 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.124728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93cb4-0cc3-41ec-9f85-3896ad63d949 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.124893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc93cb4-0cc3-41ec-9f85-3896ad63d949 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.126938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 386/789] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:32.132102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff481-38c1-4d1d-94a8-2c79a9dcf662 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.132392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff481-38c1-4d1d-94a8-2c79a9dcf662 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.132663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff481-38c1-4d1d-94a8-2c79a9dcf662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.151161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e50ff481-38c1-4d1d-94a8-2c79a9dcf662 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:32.152366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e50ff481-38c1-4d1d-94a8-2c79a9dcf662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:32.226420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 404/790] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:32.474139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aec4-33a8-4958-a27e-108ded6a4b88 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.474643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aec4-33a8-4958-a27e-108ded6a4b88 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.474643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545aec4-33a8-4958-a27e-108ded6a4b88 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.475968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 387/791] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:32.481008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.481292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.481560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.497203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545aec4-33a8-4958-a27e-108ded6a4b88 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:32.502064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:32.503252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:32.583713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 405/792] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:32.607484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545aec4-33a8-4958-a27e-108ded6a4b88 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:32.643126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:32.643782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.644057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.644326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.645434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:32.646856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:32.648614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 388/793] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:32.654339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:32.702481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:32.764487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce001d0-349a-4c7b-8469-a412f50b1e8a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:32.800878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:32.801827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.802290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.802742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:32.803717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:32.805393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:32.829085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 406/794] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:43:32 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:32.846306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:32.899014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:32.959018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454751-a641-429b-8a0c-f39792c335ba None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:32.995429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:32.996288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:32.996400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:32.996602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.009981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:33.014683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:33.016180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:33.017275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 389/795] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:43:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:33.022380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.124601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:33.133366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e9f-24ed-4e9b-9f22-294d9b350a94 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:33.168182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:33.168791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:33.169067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:33.169335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.169999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:33.170297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:33.171722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:33.181792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 407/796] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:33.186198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.288570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1c611-e063-4c84-bf14-152b441ae2b5 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:33.296492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:33.325354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:33.325975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:33.326297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:33.326567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.337493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:33.338926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:33.353284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:33.354329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:33.355212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:33.355212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:33.355212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:33.356121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 390/797] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:33.360134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.463761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b40-61ce-4ada-ade8-860db0829536 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:33.497829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:33.498436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:33.498714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:33.498981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.499640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:33.499941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:33.501802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:33.519067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 408/798] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:33.520142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.625991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a025-305d-4f03-a43d-6cf067038253 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:33.659976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:33.660866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:33.661286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:33.661695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.669565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:33.671179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:33.683168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:33.684321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:33.685474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:33.692849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 391/799] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:33.694177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.713469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:33.799225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6adc6b-ac1e-4174-bec6-a3d707cbd752 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:33.832671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:33.833269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:33.833542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:33.833809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:33.834520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:33.834818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:33.836485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:33.857976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 409/800] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:33.859414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:33.883759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:33.970007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67c7a-8b3e-4af1-9641-300e69bdab8b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.006462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.007090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.007446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.007640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.019018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.020476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-aeaab0d9-7022-4abb-8086-4bed88cc4a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:34.037454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:34.038557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:34.039959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:34.039959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:34.039959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.043357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 392/801] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:34.044192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.081707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57b03-2dac-4eb6-b3c0-7fea3d963444 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.082036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57b03-2dac-4eb6-b3c0-7fea3d963444 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.082245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c57b03-2dac-4eb6-b3c0-7fea3d963444 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.083924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 393/802] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:34.089005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.089283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.089549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.108075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:34.109235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:34.123667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.152271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1728122-d806-4cc5-860a-40b029660d68 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.181762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.187424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 394/803] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:34.191854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.192514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.192791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.193092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.193736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:34.194064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.195515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.208759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 410/804] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:34.214359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.313647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f28d-4150-4d7d-b40c-02de290d919f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.347612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.348229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.348498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.348760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.355195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.356664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:34.367869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:34.368740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:34.369664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.371699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 395/805] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:34.374611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.467237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.475125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905f396-8243-4e5e-a58c-8b5c21e75f69 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.513291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.514138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.514408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.515144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.516169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:34.516469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.518127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.519705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.527338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.533544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 411/806] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:34.539390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.574829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd2e32-0273-4561-b7df-bb8b77b0a02d None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.612956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.613876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.614337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.614789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.615497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.616848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.624522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.sql.core [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:34.624522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:43:34.624522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [parameters: {'id': '83227fd7a34b44f5ac024936b757ec58', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 17:43:34.624522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:34.642230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 17:43:34.643361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application yield resource Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application next(self.gen) Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise self.value Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application session.commit() Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 17:43:34.644347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.session.flush() Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application compat.raise_( Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 17:43:34.645243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 17:43:34.646136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application conn.query(q) Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application result.read() Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 17:43:34.646934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [parameters: {'id': '83227fd7a34b44f5ac024936b757ec58', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 17:43:34.647845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:34.648740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 396/807] 10.222.0.26 () {60 vars in 1137 bytes} [Fri Oct 14 17:43:34 2022] POST /identity/v3/domains => generated 190 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:34.649826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.652282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4da0d-fed2-4542-aa81-d6c35a162c34 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.696302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.697401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.697686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.697956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/5ad046989ce0426d9a189a8ae44cbccb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.700992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=fa4114e2020f4135bb6220c7e3aedc5c, role_id=5ad046989ce0426d9a189a8ae44cbccb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.702409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.720515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 412/808] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:34 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/fa4114e2020f4135bb6220c7e3aedc5c/roles/5ad046989ce0426d9a189a8ae44cbccb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:43:34.766889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd8a02-1006-464a-b687-759f6ee0b057 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:34.793031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.807095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:34.807771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:34.808048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:34.808311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:34.819531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:34.821014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-f7aef12e-8aa2-47c7-b2fd-627530244444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:34.837201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:34.838221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:34.839142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:34.839142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:34.839142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:34.839142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 397/809] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:34.845952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:34.909692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:34.962099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8fc1-2b00-47ef-a4ba-a006b57b7133 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:35.001890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:35.002384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.002650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.002915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.003575 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:35.003940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:35.005289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84947778-8e0f-41bb-94ef-83e0e8feff9a None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:35.023327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 413/810] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:35.090019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196cc1d-7247-45c6-b4c3-f536a7f99938 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.090357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196cc1d-7247-45c6-b4c3-f536a7f99938 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.090569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196cc1d-7247-45c6-b4c3-f536a7f99938 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.092166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 398/811] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:35.098544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.099072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.099072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.119005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:35.120257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:35.191395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 414/812] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:35.467901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196cc1d-7247-45c6-b4c3-f536a7f99938 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:35.571624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196cc1d-7247-45c6-b4c3-f536a7f99938 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:35.605638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:35.606352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.606688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.607019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.618879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:35.623846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:35.625053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:35.626208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 399/813] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:35.631399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:35.676566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:35.732549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a0484-ae7f-4319-8570-865c767cd4d5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:35.765044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:35.765668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.765943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.766209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.766861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:35.767159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:35.768533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:35.776270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 415/814] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:35.782536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:35.818733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:35.881192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ae1-d50c-43d0-9977-b2172c245862 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:35.913998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:35.914608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:35.914879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:35.915139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] PATH_INFO: `/v3/users/76dd689545384c21bf6913b4dd5928f8` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:35.927821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] RBAC: Authorizing `identity:get_user(user_id=76dd689545384c21bf6913b4dd5928f8)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:35.929254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:35.930853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 400/815] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:35 2022] GET /identity/v3/users/76dd689545384c21bf6913b4dd5928f8 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:35.936766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:36.041413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddf6d0-1bd4-4c1e-9894-b11d72758110 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:36.048409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:36.074242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:36.074855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:36.075128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:36.075487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:36.076570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] RBAC: Authorizing `identity:get_project(project_id=c7cf1a07d0bc4444bff0c7737366bb4b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:36.077967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e977df-f4b8-4acf-b431-5c761379e02b None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:36.080226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 416/816] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:43:35 2022] GET /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:36.086408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:36.175061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:36.181946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c35fd-a3b8-413c-b3a2-67ea06b8c862 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:36.214732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:36.215395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:36.215669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:36.215930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b/users/76dd689545384c21bf6913b4dd5928f8/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:36.217775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] RBAC: Authorizing `identity:create_grant(project_id=c7cf1a07d0bc4444bff0c7737366bb4b, user_id=76dd689545384c21bf6913b4dd5928f8, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:36.219858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05838-f555-45ee-8167-a2001d0a001e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:36.231857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 401/817] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:36 2022] PUT /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b/users/76dd689545384c21bf6913b4dd5928f8/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:43:36.905068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e156fd-9280-405e-ad60-c4e2b5826fff None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:36.905599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e156fd-9280-405e-ad60-c4e2b5826fff None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:36.905599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e156fd-9280-405e-ad60-c4e2b5826fff None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:36.907732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 417/818] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:36.912738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:36.913172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:36.913273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:36.931095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:36.932293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:36.997367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 402/819] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:37.268199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e156fd-9280-405e-ad60-c4e2b5826fff None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:37.367163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e156fd-9280-405e-ad60-c4e2b5826fff None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:37.400150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:37.400765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:37.401036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:37.401300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:37.411133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:37.415799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:37.416882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:37.420381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 418/820] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Oct 14 17:43:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:37.423431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:37.504226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:37.520957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d9fd5-29b5-4d28-87db-e53d74fed6f7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:37.553426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:37.554022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:37.554293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:37.554555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:37.555198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:37.555521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:37.556863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:37.565040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 403/821] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Oct 14 17:43:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:37.571102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:37.603794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:37.666867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483ca94-3017-4d09-b20b-19cd8ac4fbaf None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:37.702898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:37.703605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:37.703920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:37.704186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:37.713973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:37.715423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:37.729300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:37.730261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:37.731162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:37.731162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:37.731162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:37.731162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 419/822] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:37.736665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:37.833266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7ac16-6661-4df1-947e-620b51742422 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:37.866257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:37.866848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:37.867120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:37.867419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:37.868090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:37.868386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:37.869731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:37.881656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 404/823] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:37.887232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:37.970193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:37.985577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a02822-cfcb-4ab9-ae2e-1141a2b4d3f3 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.018374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.018994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.019266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.019560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.026789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.028216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:43:38.039156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:38.040170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:38.041092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 420/824] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Oct 14 17:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:38.046023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.054783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.147138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f54de-4c76-4942-9ba7-a3f8762361a7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.180956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.181555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.181828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.182092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.182806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:38.183107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.184546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36d58f-5f49-41b2-8f9a-c81f9f055232 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.201942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 405/825] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:38.207913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.308643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e77b8-20fa-42b3-903a-e048054b8ebd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.340973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.341567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.341839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.342105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.357004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.381380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fdc9b-6233-4416-90fc-8cb3ad3aa4e0 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.381653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fdc9b-6233-4416-90fc-8cb3ad3aa4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.381915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fdc9b-6233-4416-90fc-8cb3ad3aa4e0 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.383235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 406/826] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:43:38.388275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.388551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.388814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.405994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:38.407183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:38.409510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.410939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.464880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.473854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 407/827] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:43:38.507737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 421/828] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:38.513321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.607790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd6d2b-cafd-43e7-a839-f82e14edfee5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.640163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.640797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.641066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.641330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.650743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.652192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:43:38.666536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:38.667637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:43:38.668539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:43:38.668539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:43:38.668539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:38.668539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 408/829] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:38.673869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.719570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.743518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.771173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726169-77b5-4ce6-a179-317e517cc5c8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.790195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.805028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.805625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.805904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.806168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.806804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:38.807102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.808516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.819920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 422/830] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:38.825436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.843431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea2263-9920-4f35-9e8a-76abdb8f28c8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.876934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.877549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.877824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.878088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.888315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:38.893942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:38.894990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:38.895860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 409/831] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:38.900942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:38.927506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a774f0-7bb1-4edb-9da5-908ddc81e2e9 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:38.934210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:38.962634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:38.963264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:38.963568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:38.963835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:38.971065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:38.972609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:43:38.984637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:38.985918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:43:38.986798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 423/832] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:43:38.991761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.001719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aec5b-7464-439b-9d02-4ef8d71d8ae7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.009899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.037956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.038547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.038817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.039082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.039760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:39.040054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.041404 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.049375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 410/833] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:39.055030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.091241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453bc98-1a27-4ceb-99a1-254a380284e8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.126098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.126696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.126968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.127230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.127939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:39.128237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.129638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.141739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 424/834] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:39.147689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.154931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9696-a85c-4628-b05e-8f546ffdc7a9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.175764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.188455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.189015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.189287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.189552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] PATH_INFO: `/v3/users/76dd689545384c21bf6913b4dd5928f8` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.190667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] RBAC: Authorizing `identity:get_user(user_id=76dd689545384c21bf6913b4dd5928f8)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.192108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.193666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 411/835] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:39 2022] GET /identity/v3/users/76dd689545384c21bf6913b4dd5928f8 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:39.199196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.234261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.252484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e66b-d444-49ec-99a8-b044ff91ae94 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.286147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.286807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.287091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.287389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.288110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] RBAC: Adding query filter params (role.id=5ad046989ce0426d9a189a8ae44cbccb, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=fa4114e2020f4135bb6220c7e3aedc5c) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:39.288417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.289830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.295680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 425/836] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:39 2022] GET /identity/v3/role_assignments?user.id=fa4114e2020f4135bb6220c7e3aedc5c&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=5ad046989ce0426d9a189a8ae44cbccb => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:43:39.299916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2950542-0f52-42a7-bbb7-7ec921b8fc0c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.337421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.338035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.338310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.338577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.412628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.414093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.449796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.518421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 412/837] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 17:43:39.524477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.619356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.629761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288b9d-01fe-4072-92b1-f6a36b02ca05 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.663602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.664238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.664515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.664782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.665897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=c7cf1a07d0bc4444bff0c7737366bb4b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.667383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402573-d641-4a0f-8b77-faf96d68e9f5 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.669008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 426/838] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:43:39 2022] GET /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:39.675995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:39.779122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c8d-ff5d-4d5d-a1cf-358292f142b7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:39.813130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:39.813727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:39.813998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:39.814258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:39.814963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=c7cf1a07d0bc4444bff0c7737366bb4b, user.id=76dd689545384c21bf6913b4dd5928f8) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:39.815266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:39.816734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd28cea-d972-4015-b19a-d9051a337d78 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:39.819712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:39.823487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 413/839] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:39 2022] GET /identity/v3/role_assignments?user.id=76dd689545384c21bf6913b4dd5928f8&scope.project.id=c7cf1a07d0bc4444bff0c7737366bb4b&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:41.970859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15967b-02a9-4409-9007-8e802e938d0e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:41.971382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15967b-02a9-4409-9007-8e802e938d0e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:41.971382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15967b-02a9-4409-9007-8e802e938d0e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:41.972699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 427/840] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:41.977790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:41.978167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:41.978326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:41.996915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:41.998069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:42.061111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 414/841] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:42.329276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15967b-02a9-4409-9007-8e802e938d0e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:42.426919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15967b-02a9-4409-9007-8e802e938d0e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:42.460359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:42.460961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:42.461486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:42.461754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:42.462855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:42.464293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6afde-9013-497b-83c3-574b1378c0df None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:42.465825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 428/842] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:42.471536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:42.565097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c474-af75-4a1e-88bb-4e646948adde None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:42.592568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:42.598900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:42.599520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:42.599798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:42.600065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:42.600711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:42.602126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93360c9-f042-4eb3-a228-8fdcbe495f12 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:42.622583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 415/843] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:43:42 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:44.785530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd604a-f3ef-4150-b5d6-892abb667d37 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:44.786071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd604a-f3ef-4150-b5d6-892abb667d37 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:44.786071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd604a-f3ef-4150-b5d6-892abb667d37 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:44.787443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 429/844] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:44.792437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:44.792859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:44.792969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:44.810400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:44.811596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:44.875338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 416/845] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:45.144476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd604a-f3ef-4150-b5d6-892abb667d37 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:45.171578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:45.244845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd604a-f3ef-4150-b5d6-892abb667d37 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:45.278521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:45.279125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:45.279434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:45.279707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] PATH_INFO: `/v3/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:45.281099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] RBAC: Authorizing `identity:get_role(role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:45.282441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:45.283783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 430/846] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:45 2022] GET /identity/v3/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:45.289565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:45.387027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4b1c-cecd-4c17-a919-4e053d69db21 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:45.404433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:45.422792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:45.423436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:45.423715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:45.423983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] PATH_INFO: `/v3/users/32929bea9b51408f86d74de1887fcd04` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:45.436500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] RBAC: Authorizing `identity:get_user(user_id=32929bea9b51408f86d74de1887fcd04)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:45.438597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:45.440208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 417/847] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:45 2022] GET /identity/v3/users/32929bea9b51408f86d74de1887fcd04 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:45.445962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:45.535629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:45.542541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d700e-f050-4892-8ab1-8a45e206a713 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:45.574962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:45.575734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:45.576017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:45.576290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:45.577399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] RBAC: Authorizing `identity:get_project(project_id=c7cf1a07d0bc4444bff0c7737366bb4b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:45.579433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1761d-089f-493b-b620-d08bdd660da6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:45.581036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 431/848] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:43:45 2022] GET /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:45.587124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:45.683148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775438-b278-4eec-90be-66c2d87bafd9 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:45.717878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:45.718552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:45.718927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:45.719205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b/users/32929bea9b51408f86d74de1887fcd04/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:45.721354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] RBAC: Authorizing `identity:create_grant(project_id=c7cf1a07d0bc4444bff0c7737366bb4b, user_id=32929bea9b51408f86d74de1887fcd04, role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:45.722778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1179f4-455b-4291-b07a-a236181f54fd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:45.736074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 418/849] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:45 2022] PUT /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b/users/32929bea9b51408f86d74de1887fcd04/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:43:47.833712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eee8-5786-45df-b17b-c180c3bf794e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:47.834228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eee8-5786-45df-b17b-c180c3bf794e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:47.834228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eee8-5786-45df-b17b-c180c3bf794e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:47.835624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 432/850] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:47.840958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:47.841364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:47.841474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:47.860332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:47.861485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:47.886925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:47.928310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 419/851] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:48.198128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72eee8-5786-45df-b17b-c180c3bf794e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:48.294310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72eee8-5786-45df-b17b-c180c3bf794e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:48.326043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:48.326642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:48.326915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:48.327179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] PATH_INFO: `/v3/roles/f2bf712db5ff4496beaf17fbf5cb2418` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:48.328636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] RBAC: Authorizing `identity:get_role(role_id=f2bf712db5ff4496beaf17fbf5cb2418)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:48.329965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:48.331247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 433/852] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:48 2022] GET /identity/v3/roles/f2bf712db5ff4496beaf17fbf5cb2418 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:48.337209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:48.432276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d000d-8804-482e-ac33-95e2b6b7fcbb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:48.464560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:48.465118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:48.465393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:48.465660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] PATH_INFO: `/v3/users/32929bea9b51408f86d74de1887fcd04` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:48.466770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] RBAC: Authorizing `identity:get_user(user_id=32929bea9b51408f86d74de1887fcd04)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:48.468695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:48.470261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 420/853] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:48 2022] GET /identity/v3/users/32929bea9b51408f86d74de1887fcd04 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:48.476142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:48.506827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:48.574570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7629-0f9e-42db-a7fa-2e15f994dfb6 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:48.607505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:48.608089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:48.608366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:48.608636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:48.674625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:48.676071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:48.704726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:48.773321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 434/854] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:43:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:43:48.779238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:48.809903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:48.876793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f364-e84c-4547-a570-47c58a0b98f6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:48.909301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:48.909910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:48.910187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:48.910456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] PATH_INFO: `/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:48.911576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] RBAC: Authorizing `identity:get_project(project_id=c7cf1a07d0bc4444bff0c7737366bb4b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:48.912997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af42f-6bf0-4ea7-9079-1dd5cce22880 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:48.914586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 421/855] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:43:48 2022] GET /identity/v3/projects/c7cf1a07d0bc4444bff0c7737366bb4b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:48.920830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:49.017479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94635d2-d835-41e9-beea-0f5b5dec9f93 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:49.045018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:49.051464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:49.052053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:49.052329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:49.052596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:49.053309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] RBAC: Adding query filter params (role.id=f2bf712db5ff4496beaf17fbf5cb2418, scope.project.id=c7cf1a07d0bc4444bff0c7737366bb4b, user.id=32929bea9b51408f86d74de1887fcd04) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:49.053616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:49.055024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0744b4-7306-473e-b9b4-5161a41c311d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:49.060655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 435/856] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:43:48 2022] GET /identity/v3/role_assignments?user.id=32929bea9b51408f86d74de1887fcd04&scope.project.id=c7cf1a07d0bc4444bff0c7737366bb4b&role.id=f2bf712db5ff4496beaf17fbf5cb2418 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:51.199758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c3dc-c572-492a-9aec-f52b8df86e74 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:51.200276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c3dc-c572-492a-9aec-f52b8df86e74 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:51.200276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c3dc-c572-492a-9aec-f52b8df86e74 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:51.201597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 422/857] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:51.206801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:51.207198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:51.207390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:51.226026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:51.227218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:51.292174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 436/858] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:51.558613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c3dc-c572-492a-9aec-f52b8df86e74 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:51.653060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:51.657872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c3dc-c572-492a-9aec-f52b8df86e74 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:51.690693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:51.691329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:51.691609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:51.691872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:51.692959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:51.694361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1272a-6726-4e4f-b43d-5ec1c269962e None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:51.695922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 423/859] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:51.701690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:51.796178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b3a5e-06a6-47de-8f91-f69e66b7579c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:51.818082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:51.828953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:51.829537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:51.829809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:51.830070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:51.830702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:51.832118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7abc3-1858-424b-842b-cf63ea70264d None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:51.857194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 437/860] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:43:51 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:54.064925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14e6-a9ba-4927-b316-9aebf8fb60d8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:54.065422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14e6-a9ba-4927-b316-9aebf8fb60d8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:54.065513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b14e6-a9ba-4927-b316-9aebf8fb60d8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:54.066773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 424/861] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:54.072029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650faed-62b7-4b41-b771-532610f559ac None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:54.072444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650faed-62b7-4b41-b771-532610f559ac None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:54.072575 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650faed-62b7-4b41-b771-532610f559ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:54.090691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8650faed-62b7-4b41-b771-532610f559ac None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:54.091935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8650faed-62b7-4b41-b771-532610f559ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:54.156667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 438/862] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:54.426986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b14e6-a9ba-4927-b316-9aebf8fb60d8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:54.524003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b14e6-a9ba-4927-b316-9aebf8fb60d8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:54.555569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:54.556170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:54.556448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:54.556710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:54.557790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:54.559200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f263-8256-4ac7-bfda-6d1e822451bd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:54.560769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 425/863] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:54.566884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650faed-62b7-4b41-b771-532610f559ac None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:54.660833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650faed-62b7-4b41-b771-532610f559ac None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:54.667760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:54.695334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:54.695935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:54.696208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:54.696470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:54.697113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:54.698512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91abd-c35f-48c6-9541-efe6f082d07c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:54.719773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 439/864] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:43:54 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:43:56.859468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4665ef-b68b-43d9-8dee-3a4567b795ce None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:56.860034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4665ef-b68b-43d9-8dee-3a4567b795ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:56.860034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4665ef-b68b-43d9-8dee-3a4567b795ce None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:56.861316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 426/865] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:43:56.866492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:56.866896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:56.867039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:56.885281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:43:56.886455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:43:56.951347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 440/866] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:43:57.218369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4665ef-b68b-43d9-8dee-3a4567b795ce None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:57.259188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:57.323577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4665ef-b68b-43d9-8dee-3a4567b795ce None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:57.356843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:57.357459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:57.357738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:57.358007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:57.369397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:43:57.374788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:43:57.375745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:43:57.376588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 427/867] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:43:57.382186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:57.469830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:57.479245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f6f2c-1aff-41b0-a252-6e701df7708c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:57.511802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:57.512399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:57.512673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:57.512936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:57.513585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:43:57.513882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:57.515382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:57.523034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 441/868] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:57.528764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:57.621809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:43:57.628008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718069c-c1cd-4dc7-acfc-4e31bb5ad09b None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:57.661654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:57.662267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:57.662544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:57.662810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] PATH_INFO: `/v3/users/2994eac0b83b40d99752f959a15c19e2` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:57.675380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] RBAC: Authorizing `identity:get_user(user_id=2994eac0b83b40d99752f959a15c19e2)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:57.676812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:57.678370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 428/869] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:43:57 2022] GET /identity/v3/users/2994eac0b83b40d99752f959a15c19e2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:57.684169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:57.781712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e42e1-76a2-4b38-ba7f-2202263b7125 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:57.813504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:57.814113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:57.814389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:57.814655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] PATH_INFO: `/v3/projects/0231aed93741476a9298248f17d566f1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:57.815771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] RBAC: Authorizing `identity:get_project(project_id=0231aed93741476a9298248f17d566f1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:57.817177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bc932-3691-4b2d-9431-413302eb4959 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:57.818773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 442/870] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:43:57 2022] GET /identity/v3/projects/0231aed93741476a9298248f17d566f1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:43:57.824564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:43:57.919630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcddef1-132a-449d-8dab-fde87c847c6f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:43:57.951031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:43:57.951686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:43:57.951960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:43:57.952751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] PATH_INFO: `/v3/projects/0231aed93741476a9298248f17d566f1/users/2994eac0b83b40d99752f959a15c19e2/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:43:57.954648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] RBAC: Authorizing `identity:create_grant(project_id=0231aed93741476a9298248f17d566f1, user_id=2994eac0b83b40d99752f959a15c19e2, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:43:57.956070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8565c2-f4a2-4119-a473-be8b46f8379c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:43:57.969088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 429/871] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:43:57 2022] PUT /identity/v3/projects/0231aed93741476a9298248f17d566f1/users/2994eac0b83b40d99752f959a15c19e2/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:44:00.080037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ec59-1a27-4035-b8e0-947090c0fd23 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:00.080551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ec59-1a27-4035-b8e0-947090c0fd23 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:00.080666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ec59-1a27-4035-b8e0-947090c0fd23 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:00.081926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 443/872] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:00.087234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:00.087670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:00.087779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:00.105178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:00.106334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:00.115705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:00.171530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 430/873] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:00.440216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3ec59-1a27-4035-b8e0-947090c0fd23 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:00.464786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:00.538558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3ec59-1a27-4035-b8e0-947090c0fd23 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:00.570740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:00.571378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:00.571657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:00.571928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:00.582355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:44:00.587432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:44:00.588503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:44:00.589502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 444/874] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:44:00.594607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:00.691035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16208-423d-4a40-bab6-c69966cea121 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:00.724879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:00.725471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:00.725747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:00.726013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:00.726665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:44:00.726967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:00.728357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:00.736171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 431/875] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:00.742743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:00.821496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:00.840032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f53a40-1963-4319-bbf3-05056d5eda9e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:00.872640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:00.873246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:00.873525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:00.873794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] PATH_INFO: `/v3/users/2994eac0b83b40d99752f959a15c19e2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:00.875135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2994eac0b83b40d99752f959a15c19e2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:00.876581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:00.878134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 445/876] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:44:00 2022] GET /identity/v3/users/2994eac0b83b40d99752f959a15c19e2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:00.883850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:00.893432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:00.981889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75b7e-6650-4e1f-bbea-e779dd3003ab None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:01.014308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:01.015708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:01.015842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:01.016046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:01.080647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:01.082079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:01.089647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:01.180861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 432/877] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:44:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:44:01.187930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:01.289110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f1c-5916-4006-8406-3f53cdd527d8 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:01.321817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:01.322426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:01.322704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:01.322972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] PATH_INFO: `/v3/projects/0231aed93741476a9298248f17d566f1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:01.324179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] RBAC: Authorizing `identity:get_project(project_id=0231aed93741476a9298248f17d566f1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:01.325593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb6f62-ae7a-4087-95d2-6998a2be7744 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:01.327234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 446/878] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:44:01 2022] GET /identity/v3/projects/0231aed93741476a9298248f17d566f1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:01.333364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:01.430931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2705e-11e8-42ff-863e-20143a94135f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:01.438403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:01.465115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:01.465699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:01.465974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:01.466245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:01.466952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=0231aed93741476a9298248f17d566f1, user.id=2994eac0b83b40d99752f959a15c19e2) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:44:01.467255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:01.469730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854203-3e47-4609-8679-e39bc4e22480 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:01.475212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 433/879] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:44:01 2022] GET /identity/v3/role_assignments?user.id=2994eac0b83b40d99752f959a15c19e2&scope.project.id=0231aed93741476a9298248f17d566f1&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:03.613824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd422a-ef64-4ef8-9185-49507d93c768 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:03.614343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd422a-ef64-4ef8-9185-49507d93c768 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:03.614343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd422a-ef64-4ef8-9185-49507d93c768 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:03.615729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 447/880] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:03.621005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6c19c-f926-4cbe-9092-e30277e26113 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:03.621411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6c19c-f926-4cbe-9092-e30277e26113 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:03.621545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6c19c-f926-4cbe-9092-e30277e26113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:03.641048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5ec6c19c-f926-4cbe-9092-e30277e26113 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:03.642212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5ec6c19c-f926-4cbe-9092-e30277e26113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:03.709687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 434/881] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:04.002588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd422a-ef64-4ef8-9185-49507d93c768 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:04.021459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:04.108097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd422a-ef64-4ef8-9185-49507d93c768 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:04.141516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:04.142109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:04.142385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:04.142653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:04.143333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:04.144676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98eb50-54d1-4bfe-91c7-f222a15d6704 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:04.160055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 448/882] 10.222.0.26 () {60 vars in 1138 bytes} [Fri Oct 14 17:44:04 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:44:06.343351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bcef-b726-4527-b96a-237c18f95266 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:06.345291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bcef-b726-4527-b96a-237c18f95266 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:06.345291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bcef-b726-4527-b96a-237c18f95266 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:06.345507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 435/883] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:06.350807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803191d-f927-43e0-8773-446146fee907 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:06.351218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803191d-f927-43e0-8773-446146fee907 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:06.351403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803191d-f927-43e0-8773-446146fee907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:06.369670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9803191d-f927-43e0-8773-446146fee907 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:06.370844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9803191d-f927-43e0-8773-446146fee907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:06.434467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 449/884] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:06.714023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274bcef-b726-4527-b96a-237c18f95266 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:06.817613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:06.821886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274bcef-b726-4527-b96a-237c18f95266 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:06.857990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:06.859202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:06.859599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:06.859917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] PATH_INFO: `/v3/domains/2e5f181014134e03b8f95cb4abd44429` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:06.870794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2e5f181014134e03b8f95cb4abd44429)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:06.872324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0981-5619-4ae6-bc02-486a142b1894 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:06.874724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 436/885] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Oct 14 17:44:06 2022] GET /identity/v3/domains/2e5f181014134e03b8f95cb4abd44429 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:06.880631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803191d-f927-43e0-8773-446146fee907 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:06.890518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:06.977042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803191d-f927-43e0-8773-446146fee907 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:07.009968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:07.010557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:07.010833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:07.011101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:07.011772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:07.013184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012c4e-8996-4f55-ad2f-0a9921bc3468 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:07.038673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 450/886] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:44:06 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:44:09.274496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d249-6749-4610-9c8d-8a17df1b2d06 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:09.275039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d249-6749-4610-9c8d-8a17df1b2d06 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:09.275139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d249-6749-4610-9c8d-8a17df1b2d06 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:09.276521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 437/887] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:09.281837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:09.282276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:09.282378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:09.300164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:09.301343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:09.355990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:09.368193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 451/888] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:09.638282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69d249-6749-4610-9c8d-8a17df1b2d06 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:09.738484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69d249-6749-4610-9c8d-8a17df1b2d06 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:09.771312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:09.771932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:09.772210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:09.772478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] PATH_INFO: `/v3/domains/2e5f181014134e03b8f95cb4abd44429` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:09.773583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=2e5f181014134e03b8f95cb4abd44429)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:09.775001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c6c96-db04-49c4-b909-136692a23c4c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:09.776587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 438/889] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Oct 14 17:44:09 2022] GET /identity/v3/domains/2e5f181014134e03b8f95cb4abd44429 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:09.782462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:09.879001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5fdec-423f-482b-afc4-572f26b100e2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:09.911341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:09.911897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:09.912176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:09.912447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:09.913101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:09.914501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099060bc-ddb9-466c-bfb3-15a5555b3a6f None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:09.935395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 452/890] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:44:09 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:44:12.073966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416301b-b4bc-48aa-a12a-950b1777cf11 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:12.074500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416301b-b4bc-48aa-a12a-950b1777cf11 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:12.074500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416301b-b4bc-48aa-a12a-950b1777cf11 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:12.075953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 439/891] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:12.081978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:12.082379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:12.082519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:12.101073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:12.102241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:12.142271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:12.167108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 453/892] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:12.445506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416301b-b4bc-48aa-a12a-950b1777cf11 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:12.473483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:12.546304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416301b-b4bc-48aa-a12a-950b1777cf11 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:12.578341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:12.578955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:12.579233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:12.579536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:12.589525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:44:12.594955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:44:12.596146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:44:12.597047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 440/893] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:44:12.602157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:12.698800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d08f7-5cae-43da-804a-d4a8e8ad00a5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:12.734301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:12.734895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:12.735170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:12.735465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:12.736117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:44:12.736412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:12.737752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:12.745411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 454/894] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:12.751468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:12.835684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:12.848410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c299-7afc-4df6-9cb3-71e4ac74472c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:12.880136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:12.880738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:12.881008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:12.881274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] PATH_INFO: `/v3/users/33e34b4e9e4145e584862aeaa17fabd1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:12.894089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] RBAC: Authorizing `identity:get_user(user_id=33e34b4e9e4145e584862aeaa17fabd1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:12.895536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:12.897075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 441/895] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:44:12 2022] GET /identity/v3/users/33e34b4e9e4145e584862aeaa17fabd1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:12.902847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:12.942927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:13.001865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d949-9565-43c9-90c2-5ef8d46dcf36 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:13.034597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:13.035205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:13.035509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:13.035777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] PATH_INFO: `/v3/projects/c02cd15326234f5d8488dc9ed4308fe8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:13.036870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cd15326234f5d8488dc9ed4308fe8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:13.038276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdd94b-b4f8-4b3f-a19f-a9ec952a9b63 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:13.039897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 455/896] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:44:12 2022] GET /identity/v3/projects/c02cd15326234f5d8488dc9ed4308fe8 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:13.046424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:13.141862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fffe3-e49e-46d2-b65a-effdbb51ae23 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:13.175209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:13.175872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:13.176155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:13.176427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] PATH_INFO: `/v3/projects/c02cd15326234f5d8488dc9ed4308fe8/users/33e34b4e9e4145e584862aeaa17fabd1/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:13.178305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02cd15326234f5d8488dc9ed4308fe8, user_id=33e34b4e9e4145e584862aeaa17fabd1, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:13.179765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ec593-ab1d-4091-a89e-56de6225cf16 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:13.192105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 442/897] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:44:13 2022] PUT /identity/v3/projects/c02cd15326234f5d8488dc9ed4308fe8/users/33e34b4e9e4145e584862aeaa17fabd1/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:44:15.298645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2d0e-f99d-4937-b9fe-4428f526eeca None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:15.299197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2d0e-f99d-4937-b9fe-4428f526eeca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:15.299197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2d0e-f99d-4937-b9fe-4428f526eeca None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:15.300559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 456/898] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:44:15.306001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:15.306409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:15.306588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:15.320577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:15.326274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:44:15.328336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:44:15.399705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 443/899] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:44:15.663987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2d0e-f99d-4937-b9fe-4428f526eeca None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:15.762310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2d0e-f99d-4937-b9fe-4428f526eeca None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:15.769905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:15.796859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:15.797473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:15.797748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:15.798015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:15.807720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:44:15.816666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:44:15.817785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:44:15.818831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 457/900] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:44:15.823953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:15.919543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58260f7-beeb-4309-b379-f27f2bd4b6ae None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:15.951555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:15.952676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:15.952952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:15.953219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:15.953869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:44:15.954169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:15.955547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:15.957633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:15.964079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 444/901] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:15.971223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:16.066113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5476786-502e-4167-8b04-ee434bc54cbd None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:16.100633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:16.101239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:16.101525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:16.101796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] PATH_INFO: `/v3/users/33e34b4e9e4145e584862aeaa17fabd1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:16.103028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] RBAC: Authorizing `identity:get_user(user_id=33e34b4e9e4145e584862aeaa17fabd1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:16.104500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:16.106041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 458/902] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Oct 14 17:44:15 2022] GET /identity/v3/users/33e34b4e9e4145e584862aeaa17fabd1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:16.112220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:16.210010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe28-5718-48f2-b501-1c7ae8df68be None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:16.243076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:16.243684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:16.243957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:16.244219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:16.304868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:16.308765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:16.310187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:16.403719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 445/903] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:44:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 17:44:16.410754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:16.445211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:16.513711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522a142-8558-4361-b2c1-5746093beeae None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:16.549524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:16.550147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:16.550459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:16.550752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] PATH_INFO: `/v3/projects/c02cd15326234f5d8488dc9ed4308fe8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:16.551941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c02cd15326234f5d8488dc9ed4308fe8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:16.553418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92d189-081b-4f16-b08d-5f3cc4ab43c0 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:16.555081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 459/904] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Oct 14 17:44:16 2022] GET /identity/v3/projects/c02cd15326234f5d8488dc9ed4308fe8 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:16.561085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:44:16.654118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:16.659062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10c094-12a3-4f14-a783-8d5d286bd646 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:44:16.693018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:44:16.693618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:44:16.693896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:44:16.694166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:44:16.694887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=c02cd15326234f5d8488dc9ed4308fe8, user.id=33e34b4e9e4145e584862aeaa17fabd1) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:44:16.695193 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:44:16.696638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf6428-caa2-4889-b8f2-896c8ae315dd None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:44:16.702339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 446/905] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:44:16 2022] GET /identity/v3/role_assignments?user.id=33e34b4e9e4145e584862aeaa17fabd1&scope.project.id=c02cd15326234f5d8488dc9ed4308fe8&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:44:26.545259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=49 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:44:26.699784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=19 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:12.674150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab746-31f9-4696-9bb9-40d643217496 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:12.674722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab746-31f9-4696-9bb9-40d643217496 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:12.674722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab746-31f9-4696-9bb9-40d643217496 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:12.676222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 460/906] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:45:12.681522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:12.681986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:12.682069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:12.711677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:12.712862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:12.806487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 447/907] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:13.081354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ab746-31f9-4696-9bb9-40d643217496 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:13.207724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ab746-31f9-4696-9bb9-40d643217496 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:13.253232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:13.253909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:13.254355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:13.254632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:13.267720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:13.269537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:13.288551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:13.289978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:13.291092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:13.291092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:13.291092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:13.291092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 461/908] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:13.297794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:13.429908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c9c4-7529-47b4-b700-5bae3b48b196 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:13.463609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:13.472379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:13.473030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:13.473315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:13.473582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:13.474225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:13.474521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:13.475912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce440ed-1063-4899-83c0-05ac562f5956 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:13.496398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 448/909] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:13.500892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:13.576849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:13.637444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9235-bfc7-4368-b2b2-b560a5130241 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:13.686183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:13.686951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:13.687050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:13.687309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:13.690520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:13.692381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3e2c1-9af6-4e0e-8725-f115cbd60bb8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:13.723317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 462/910] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Oct 14 17:45:13 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:45:15.968105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2919-63e0-4180-a72d-bfca714c94d3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:15.968670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2919-63e0-4180-a72d-bfca714c94d3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:15.968670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2919-63e0-4180-a72d-bfca714c94d3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:15.970069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 449/911] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:15.975683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:15.976133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:15.976386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:16.000366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:16.001608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:16.081361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 463/912] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:16.351427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2919-63e0-4180-a72d-bfca714c94d3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:16.482232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2919-63e0-4180-a72d-bfca714c94d3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:16.525862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:16.527731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:16.527731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:16.527731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:16.539519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:45:16.546442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:16.551638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:16.552575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 450/913] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:16.553860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:16.602530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:16.670131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd5ae-d7c1-4c6f-99b3-363fc012a73a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:16.711043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:16.712666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:16.712666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:16.712666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:16.713345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:16.713608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:16.715112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:16.724664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 464/914] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:16.731131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:16.789795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:16.849436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deefc1-07d6-4739-a2f7-c60ea6025dc8 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:16.888350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:16.888950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:16.889206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:16.889485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:16.900659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:16.902230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:16.918747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:16.920882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:16.921925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:16.921925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:16.921925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:16.921925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 451/915] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:45:16.926324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.035746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:17.041350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a0526-4424-469b-9e4e-2ffbea3f3aa1 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:17.083384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:17.084233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:17.085815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:17.085815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:17.086011 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:17.086182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:17.087945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:17.105715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 465/916] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:45:17.107598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.227007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5307d-9495-4c9e-99d9-e13ec58a6936 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:17.228860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:17.270872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:17.272248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:17.272248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:17.272455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:17.280897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:17.282435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:45:17.294031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:17.295330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:17.296441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 452/917] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:17.301596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.437851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a489e-cd76-411e-909e-bf9015a5e356 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:17.482390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:17.482988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:17.483353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:17.483640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:17.484460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:17.484774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:17.486480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:17.508972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 466/918] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Oct 14 17:45:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:17.515120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.622069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3209-7096-481f-828e-f8eab10a9bef None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:17.664388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:17.665168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:17.665456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:17.665748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:17.677404 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:17.678876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:17.697684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:17.698641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:17.699585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:17.699585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:17.699585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:17.699585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 453/919] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:17.705504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.727553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:17.826087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7d533-9b1b-4f8c-9c76-f24fbae0a065 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:17.865290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:17.865885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:17.866157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:17.866421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:17.867055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:17.867377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:17.868755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:17.880408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 467/920] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:17.889402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:17.909536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:18.005072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48ab3-b255-411e-ba1d-3d4be4311deb None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:18.041575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:18.042212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:18.042482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:18.042746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:18.050188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:18.051646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:45:18.063116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:18.064236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:18.068458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 454/921] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:18.070332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:18.168766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:18.197516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6551bd-4a46-49ce-b171-4160b61be8e7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:18.238408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:18.238964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:18.239244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:18.239548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:18.240243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:18.240544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:18.241990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0c183-67c3-4ec2-998f-8b449f8a63c3 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:18.255956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 468/922] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:18.262045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:18.352986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:18.384346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450fe59-ac83-4ad1-bc84-877d70b34be7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:18.428340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:18.429260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:18.429620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:18.430086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/233bd3bd3a8f4d8484a6873a61cab231/roles/f1d971ab7ad94ca39fb26841b3390cee` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:18.447789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=233bd3bd3a8f4d8484a6873a61cab231, role_id=f1d971ab7ad94ca39fb26841b3390cee)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:18.449384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ba1a0-6bf0-4de0-a94f-4980a1fd8a16 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:18.463591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 455/923] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:45:18 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/233bd3bd3a8f4d8484a6873a61cab231/roles/f1d971ab7ad94ca39fb26841b3390cee => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:45:20.678264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f472a-e056-4b3d-91dc-89382171497f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:20.678802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f472a-e056-4b3d-91dc-89382171497f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:20.678802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f472a-e056-4b3d-91dc-89382171497f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:20.682239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 469/924] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:20.686232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:20.686654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:20.686772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:20.706155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:20.707387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:20.779669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 456/925] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:21.074985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f472a-e056-4b3d-91dc-89382171497f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:21.189604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f472a-e056-4b3d-91dc-89382171497f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:21.232959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:21.233582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:21.233858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:21.234157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:21.242428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:21.246835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:45:21.253198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:21.255381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:21.256640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 470/926] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:21.261156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:21.324422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:21.377336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2857b-e00f-4ad9-b3c5-4e419a78e282 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:21.419795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:21.420309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:21.420587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:21.420833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:21.421551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:21.421856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:21.423336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:21.432029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 457/927] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:21.438926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:21.552616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9057b8-29e5-456b-8cb2-5eaac165ecfe None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:21.595220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:21.595939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:21.596232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:21.596536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:21.608153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:21.609652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:21.628854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:21.630024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:21.631040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:21.631040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:21.631040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:21.631040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 471/928] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:21.636031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:21.746499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd43a2-7315-49d6-9cd0-f942d67253f6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:21.763664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:21.781555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:21.782159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:21.782438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:21.782725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:21.783396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:21.783699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:21.785056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:21.798406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 458/929] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:45:21.804196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:21.860271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:21.915925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f25e2c-4b82-4e2d-87b1-03f0e3d06661 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:21.952490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:21.953121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:21.954320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:21.954436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:21.963256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:21.964804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:45:21.979061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:21.980375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:21.981511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 472/930] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:21.987288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:22.106336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f793cdb-bcbc-4bdf-8703-9a8630c386e4 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:22.152802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:22.153649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:22.153939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:22.154241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:22.155169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:22.155529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:22.157546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:22.184067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 459/931] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Oct 14 17:45:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:22.185726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:22.322323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd2a5-96d2-4eca-9d2e-9b49c1c74e47 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:22.334544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:22.365952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:22.366603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:22.367182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:22.367496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:22.462453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:22.463876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:22.575430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 473/932] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:45:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 17:45:22.577049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:22.617983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:22.704536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab355a-00b0-4098-a0fe-0041804daaad None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:22.740519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:22.741142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:22.741459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:22.741734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:22.753586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:22.755301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:22.773892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:22.775178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:22.776317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:22.776317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:22.776317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:22.776317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 460/933] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:22.782856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:22.796484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:22.905616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024bbf5-f227-436b-af39-04ae25c80920 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:22.944237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:22.944888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:22.945116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:22.945379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:22.946098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:22.946400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:22.947787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:22.959799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 474/934] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:22.966321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:23.060799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:23.077048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b630a4-d9cb-4f3d-86f6-899760d368b6 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:23.113374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:23.114053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:23.114326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:23.114599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:23.121688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:23.123509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:45:23.134829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:23.135906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:23.136990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 461/935] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:23.142699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:23.217253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:23.253076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853eb8f-1bc9-4dc6-8ac0-865448479006 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:23.290580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:23.291290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:23.291650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:23.291985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:23.292747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:23.293056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:23.294529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610733a4-1943-430f-8586-707d2e0a3b6c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:23.307763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 475/936] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:45:23.314265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:23.436947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af921927-e49d-4c28-927e-90c717a3f76f None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:23.473823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:23.474416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:23.474688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:23.474951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:23.475688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] RBAC: Adding query filter params (role.id=f1d971ab7ad94ca39fb26841b3390cee, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=233bd3bd3a8f4d8484a6873a61cab231) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:23.475990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:23.477399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b9be-ddd6-4f15-aa35-ec21412d654a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:23.483334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 462/937] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:45:23 2022] GET /identity/v3/role_assignments?user.id=233bd3bd3a8f4d8484a6873a61cab231&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=f1d971ab7ad94ca39fb26841b3390cee => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:25.740438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521738-3cf2-4be5-bc77-c461d7df155e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:25.740956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521738-3cf2-4be5-bc77-c461d7df155e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:25.741047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521738-3cf2-4be5-bc77-c461d7df155e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:25.742327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 476/938] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:25.748463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:25.748998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:25.749103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:25.768677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:25.770030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:25.772937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:25.842179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 463/939] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:26.123628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88521738-3cf2-4be5-bc77-c461d7df155e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:26.237184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88521738-3cf2-4be5-bc77-c461d7df155e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:26.270135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:26.276817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:26.277548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:26.278066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:26.279309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:26.291421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:45:26.297379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:26.298591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:26.299510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 477/940] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:26.304905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:26.415249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ad91c-39e1-4ab5-8523-9089bb615099 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:26.456721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:26.457399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:26.457664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:26.458001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:26.458757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:26.459058 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:26.460457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:26.470570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 464/941] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:26.476823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:26.584821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfcdbc-dc6c-4a20-920a-331f61ec38f0 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:26.619484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:26.620094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:26.620372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:26.620635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:26.633106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:26.634688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:26.651521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:26.652660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:26.654119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:26.654119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:26.654119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:26.656517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 478/942] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:26.662878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:26.666419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:26.797321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1522856-8f78-406e-bdd0-0dae3862ece7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:26.832630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:26.833237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:26.833500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:26.834999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:26.834999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:26.834999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:26.836089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:26.850861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 465/943] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:26.857483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:26.909175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:26.970340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ea72-2af0-434f-8735-f6bfbf3a952c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.008661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.009294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.009568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.009862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.018540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.020010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:45:27.032354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:27.033849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:27.035023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 479/944] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:45:27.040195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.114448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:27.158790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed06c0-c826-4444-8943-a883f3b6dc0c None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.195631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.196255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.196536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.196811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.197543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:27.197853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.199281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.218017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 466/945] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Oct 14 17:45:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:27.224059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.337302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86a1-021a-41d9-865c-a05476f39321 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.338857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:27.375411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.376033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.376307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.376573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.386642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.389049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:27.405761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:27.407022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:27.408161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:27.408161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:27.408161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:27.408161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 480/946] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:27.413363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.525693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81945-956d-4a76-9ec7-9e0fc8ad33d3 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.550581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:27.570061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.570859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.571142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.571466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.572156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:27.572633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.574175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.588126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 467/947] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:45:27.593942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.717801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b6c7f-6960-4514-9b4b-af0af41abc85 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.758834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b812-c220-434b-b816-11252d972d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.759527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b812-c220-434b-b816-11252d972d45 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.759804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b812-c220-434b-b816-11252d972d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.760074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b812-c220-434b-b816-11252d972d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.767218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b812-c220-434b-b816-11252d972d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.768734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b812-c220-434b-b816-11252d972d45 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-3856b812-c220-434b-b816-11252d972d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:45:27.781229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:27.782310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:27.783594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 481/948] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:27.788634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.899179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fe09-e953-4d58-bb1a-ab08a332e673 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:27.934025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:27.935207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:27.935730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:27.936093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:27.936782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:27.937087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:27.938516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c413a-518a-4e56-bd8a-b0bdabb16d23 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:27.954228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 468/949] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:27.959958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b812-c220-434b-b816-11252d972d45 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:27.980734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:28.079259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b812-c220-434b-b816-11252d972d45 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:28.118985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:28.119672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:28.119947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:28.120213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] PATH_INFO: `/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/233bd3bd3a8f4d8484a6873a61cab231/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:28.122103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdbf2b97ec41f99a8035432829bb5f, user_id=233bd3bd3a8f4d8484a6873a61cab231, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:28.123683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309590b-7486-43bd-81da-803f34a133b4 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:28.137446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 482/950] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Oct 14 17:45:27 2022] PUT /identity/v3/projects/b6fdbf2b97ec41f99a8035432829bb5f/users/233bd3bd3a8f4d8484a6873a61cab231/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:45:30.354261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368e2-d0da-4b02-8564-64c59c847e4d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:30.354837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368e2-d0da-4b02-8564-64c59c847e4d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:30.354837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368e2-d0da-4b02-8564-64c59c847e4d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:30.356157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 469/951] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:45:30.362003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:30.362436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:30.362572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:30.383376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:30.385091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:30.485070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 483/952] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:45:30.766979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152368e2-d0da-4b02-8564-64c59c847e4d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:30.816285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:30.885454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152368e2-d0da-4b02-8564-64c59c847e4d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:30.926869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:30.927603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:30.927965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:30.928178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:30.938231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 17:45:30.943500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:30.944627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:30.945477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 470/953] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Oct 14 17:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:30.951119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:30.954169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:31.061817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742440f0-40ba-41a9-8aa5-cb186b0c90fc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.096421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.097253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.097624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.097898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:31.098715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:31.099004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:31.100495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:31.109991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 484/954] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Oct 14 17:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:31.115920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:31.217580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:31.220590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29070d-f448-44b4-9efb-d762f387abea None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.257294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.257885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.258166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.258471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:31.269166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:31.270656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:31.285895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:31.287346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:31.288740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:31.288740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:31.288740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:31.292286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 471/955] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:31.293309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:31.366255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:31.407453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2785-f2c9-45a4-869a-d90b66bcfaf7 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.445173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.445921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.446272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.446619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:31.447423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:31.447793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:31.449213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:31.468119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 485/956] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:45:31.469193 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:31.584778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac50fe-055d-43eb-995c-ebd8fc427a47 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.618996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.619692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.619969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.620283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:31.629147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:31.630600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 17:45:31.642555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:31.643746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:31.644924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 472/957] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 17:45:31.649827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:31.765474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ea74-61ea-429a-99f5-029b81d7391c None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.793246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:31.802676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.803317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.803594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.803873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:31.804616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:31.804922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:31.806363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:31.827010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 486/958] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Oct 14 17:45:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:31.833037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:31.849817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:31.939713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf25f-3e22-4e26-8dae-6a876c7033b1 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:31.974550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:31.975153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:31.975456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:31.975722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.045110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.046566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.061697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:32.154111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 473/959] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Oct 14 17:45:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 17:45:32.160049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:32.261304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c39e3-d015-47ec-9cab-93ada0380a4e None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:32.296087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:32.296637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:32.296914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:32.297178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.307261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.308737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 17:45:32.323132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:32.324348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 17:45:32.325983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 17:45:32.325983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 17:45:32.325983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:32.325983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 487/960] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:32.330876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:32.446692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adeb54-0c6a-4590-9618-91e4cb91eb5a None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:32.460355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:32.482468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:32.483065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:32.483358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:32.483629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.484262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:32.484560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.485907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.496741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 474/961] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Oct 14 17:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:32.502798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:32.537941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:32.602825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5d4f2-12c4-4425-be97-c99b4b10dfeb None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:32.635536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:32.636140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:32.636415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:32.636695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.643864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.645274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 17:45:32.656515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:32.657532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: ERROR keystone.server.flask.application Oct 14 17:45:32.658620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 488/962] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Oct 14 17:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:32.663523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:32.760376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c632-d874-4cdb-bcd5-6428c6e17573 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:32.792569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49938878-822e-4032-827e-f323147bd644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:32.793159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938878-822e-4032-827e-f323147bd644 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:32.793432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938878-822e-4032-827e-f323147bd644 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:32.793695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938878-822e-4032-827e-f323147bd644 None admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.794512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49938878-822e-4032-827e-f323147bd644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:32.794814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49938878-822e-4032-827e-f323147bd644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.796244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49938878-822e-4032-827e-f323147bd644 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.807491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 475/963] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Oct 14 17:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:32.813948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:32.907599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:32.913525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b6e8-2b95-4223-98ee-5c3ffdff5839 None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:32.945872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:32.946454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:32.946727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:32.946993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:32.947732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] RBAC: Adding query filter params (role.id=87f9d55d22b7471e941216189675256a, scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f, user.id=233bd3bd3a8f4d8484a6873a61cab231) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:32.948036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:32.949445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2a19-9063-44d5-a9b6-cd545d7fd420 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:32.956025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 489/964] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Oct 14 17:45:32 2022] GET /identity/v3/role_assignments?user.id=233bd3bd3a8f4d8484a6873a61cab231&scope.project.id=b6fdbf2b97ec41f99a8035432829bb5f&role.id=87f9d55d22b7471e941216189675256a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:35.101426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664dc0a-fd2f-4d8d-a8fa-48be9447d929 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:35.101941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664dc0a-fd2f-4d8d-a8fa-48be9447d929 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:35.101941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664dc0a-fd2f-4d8d-a8fa-48be9447d929 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:35.103290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 476/965] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:35.109177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:35.109569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:35.109706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:35.127208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:35.128397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:35.191724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 490/966] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:35.457129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664dc0a-fd2f-4d8d-a8fa-48be9447d929 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:35.487746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:35.557394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664dc0a-fd2f-4d8d-a8fa-48be9447d929 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:35.589992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:35.591265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:35.591576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:35.591847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:35.592425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:35.593780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:35.602360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:35.603597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:35.604687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 477/967] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:45:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:35.609546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:35.694841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:35.705239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8172-dd8f-4246-8a4b-6c7176af9191 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:35.738328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:35.738857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:35.739131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:35.739429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:35.740056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:35.740356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:35.741728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fa6c-629f-44b8-834d-d4c90ee7f449 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:35.746429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 491/968] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Oct 14 17:45:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:35.752761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:35.844590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:35.850424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbced2f-252c-4af2-8986-f146d6ae17ab None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:35.883162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:35.883773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:35.884049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:35.884316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] PATH_INFO: `/v3/services` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:35.884928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:35.885226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:35.886579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d36471-3171-4f3b-a144-9d1ed69c93f3 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:35.890817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 478/969] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Oct 14 17:45:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:38.069757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7c21d-ef19-4bfe-88d5-e6f3ccd7e5b6 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:38.070325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7c21d-ef19-4bfe-88d5-e6f3ccd7e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:38.070325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7c21d-ef19-4bfe-88d5-e6f3ccd7e5b6 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:38.071669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 492/970] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:38.077699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610e3b-781b-4fc7-bc47-ae6c6330f024 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:38.078127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610e3b-781b-4fc7-bc47-ae6c6330f024 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:38.078224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52610e3b-781b-4fc7-bc47-ae6c6330f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:38.096046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-52610e3b-781b-4fc7-bc47-ae6c6330f024 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:38.097200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-52610e3b-781b-4fc7-bc47-ae6c6330f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:38.160317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 479/971] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 17:45:38.436984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7c21d-ef19-4bfe-88d5-e6f3ccd7e5b6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:38.536066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7c21d-ef19-4bfe-88d5-e6f3ccd7e5b6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:38.568547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:38.569128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:38.569402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:38.569665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:38.570362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:38.571779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c898a-9cf0-4d32-ad2d-321bce603990 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:38.586753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 493/972] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Oct 14 17:45:38 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:45:40.726996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183f5f-c3d9-4cb0-88d0-b75ba00ede86 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:40.727491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183f5f-c3d9-4cb0-88d0-b75ba00ede86 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:40.727592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183f5f-c3d9-4cb0-88d0-b75ba00ede86 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:40.728909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 480/973] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:40.734340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:40.734726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:40.734891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:40.753251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:40.754432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:40.764035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:40.828736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 494/974] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:41.096958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183f5f-c3d9-4cb0-88d0-b75ba00ede86 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:41.188538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:41.199486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183f5f-c3d9-4cb0-88d0-b75ba00ede86 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:41.233798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:41.234405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:41.234676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:41.235000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:41.235601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:41.237116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:41.245927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:41.247197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:41.248532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 481/975] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:45:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:41.253136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:41.349621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98e77-6e4a-4eb4-87ea-bc3f9b344db1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:41.385137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:41.386347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:41.386807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:41.388085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:41.389443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] RBAC: Adding query filter params (name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:41.390060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:41.392442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:41.401494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 495/976] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Oct 14 17:45:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:41.409410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:41.513806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2de4-7ba3-4286-aae8-1d7b38d1da55 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:41.545658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:41.546263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:41.546574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:41.546844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:41.547558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] RBAC: Adding query filter params (interface=public, service_id=6f7a501cb8fd43588dc05899ad9b3db4, region_id=RegionOne) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:41.547862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:41.549209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ed411-33d5-4e53-8e40-818ab992ebd4 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:41.554001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 482/977] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Oct 14 17:45:41 2022] GET /identity/v3/endpoints?service_id=6f7a501cb8fd43588dc05899ad9b3db4&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:41.560364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:41.564100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:41.658174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5099094-a70d-470a-946c-9b886438c3af None admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:41.691385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:41.692174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:41.692271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:41.692527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:41.693132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:41.694482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd196e-c865-4891-ba68-595cd1f1a89e None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:41.701817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 496/978] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Oct 14 17:45:41 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:45:43.853407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163735af-b6b9-46b6-90e1-c10c28a2e3d1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:43.853947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163735af-b6b9-46b6-90e1-c10c28a2e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:43.853947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163735af-b6b9-46b6-90e1-c10c28a2e3d1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:43.855298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 483/979] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:45:43.861195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:43.861611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:43.861741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:43.879613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:45:43.880843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:45:43.940788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:43.946682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 497/980] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:45:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 17:45:44.209829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163735af-b6b9-46b6-90e1-c10c28a2e3d1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:44.228818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:44.307808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163735af-b6b9-46b6-90e1-c10c28a2e3d1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:44.341219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:44.341824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:44.342096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:44.342356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:44.342920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:44.344301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 17:45:44.352622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 17:45:44.353775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application with Lock( Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self._enter() Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application return self.creator() Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application created_value = creator( Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: ERROR keystone.server.flask.application Oct 14 17:45:44.354941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 484/981] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Oct 14 17:45:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 17:45:44.360140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:44.463509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be0a29-b2ae-45d6-8a6d-9625ecd00ff8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:44.497045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:44.497646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:44.497926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:44.498196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] PATH_INFO: `/v3/services` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:44.498818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:45:44.499117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:44.500506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d62f65-a7a3-49da-8c5c-a416313377b8 None admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:44.505522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 498/982] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Oct 14 17:45:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:45:44.511321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:45:44.592095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:44.610400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697aad-d47c-4f94-a72b-7d65641283f7 None admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:45:44.642464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082503-8ed8-429d-9431-506b66469968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:45:44.643047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082503-8ed8-429d-9431-506b66469968 None admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:45:44.643342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082503-8ed8-429d-9431-506b66469968 None admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:45:44.643610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082503-8ed8-429d-9431-506b66469968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:45:44.644268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082503-8ed8-429d-9431-506b66469968 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:45:44.645613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082503-8ed8-429d-9431-506b66469968 None admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:45:44.664287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 485/983] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:45:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:45:54.502925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=69 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:45:54.660197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:48.668204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc133a-4f8e-415f-ae89-be6010e46e60 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:48.668682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc133a-4f8e-415f-ae89-be6010e46e60 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:48.668761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc133a-4f8e-415f-ae89-be6010e46e60 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:48.676631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0bc3-27f0-486f-86b4-34b023c5c3c1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:48.677093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0bc3-27f0-486f-86b4-34b023c5c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:48.677183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0bc3-27f0-486f-86b4-34b023c5c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:48.693132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 499/984] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:46:48 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:48.785848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0a1b0bc3-27f0-486f-86b4-34b023c5c3c1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:48.787391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a1b0bc3-27f0-486f-86b4-34b023c5c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:48.895226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 486/985] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:46:49.193749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:49.194027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:49.194439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:49.196055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 500/986] 10.222.0.26 () {54 vars in 964 bytes} [Fri Oct 14 17:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:49.203176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd384-7ebc-4f4b-9a3b-2efcdc441016 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:49.203504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd384-7ebc-4f4b-9a3b-2efcdc441016 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:49.203795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd384-7ebc-4f4b-9a3b-2efcdc441016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:49.290227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-571fd384-7ebc-4f4b-9a3b-2efcdc441016 None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:49.291625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-571fd384-7ebc-4f4b-9a3b-2efcdc441016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:49.314305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:49.375923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 487/987] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Oct 14 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:46:49.384899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:46:49.386786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:49.506113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15691edc-e582-4afe-8af2-b07b9bbf7743 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:46:49.589042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:46:49.589948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:49.590226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:49.590496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:49.592250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:49.651738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:49.724134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:46:49.725632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e099b-f56b-4016-9e55-627efed06499 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:46:49.748580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 501/988] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:46:52.191998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4edf-ccc9-4d21-89ae-672bb4c3681d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:52.192499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4edf-ccc9-4d21-89ae-672bb4c3681d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:52.192499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4edf-ccc9-4d21-89ae-672bb4c3681d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:52.193800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 488/989] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:52.199016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073eb2-7664-406d-b99a-0792dd4a0eb4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:52.199442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073eb2-7664-406d-b99a-0792dd4a0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:52.199586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073eb2-7664-406d-b99a-0792dd4a0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:52.280119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3e073eb2-7664-406d-b99a-0792dd4a0eb4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:52.281295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3e073eb2-7664-406d-b99a-0792dd4a0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:52.374954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 502/990] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:46:52.676724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:52.677009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:52.677278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:52.678690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 489/991] 10.222.0.26 () {54 vars in 964 bytes} [Fri Oct 14 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:52.684898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262dde-6cbc-4372-9d3b-4026926064b3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:52.685286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262dde-6cbc-4372-9d3b-4026926064b3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:52.685621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93262dde-6cbc-4372-9d3b-4026926064b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:52.701795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:52.767996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-93262dde-6cbc-4372-9d3b-4026926064b3 None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:52.769199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-93262dde-6cbc-4372-9d3b-4026926064b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:52.844162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 503/992] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Oct 14 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:46:52.853071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:46:52.854719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:52.958287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdec7be-cc3a-4c87-b2e2-7c8c1976bcc9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:46:53.030330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:53.032873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:46:53.033510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:53.034018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:53.034497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:53.036326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:53.143953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:46:53.145310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fca554-f343-4bc0-9741-a3fe65a17340 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:46:53.163044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 490/993] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:46:55.868112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:55.868638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:55.868729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:55.870031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 504/994] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:55.875270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c914-c0e6-4ff9-942e-5c1d8b78deb9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:55.875748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c914-c0e6-4ff9-942e-5c1d8b78deb9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:55.875856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c914-c0e6-4ff9-942e-5c1d8b78deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:55.941054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d225c914-c0e6-4ff9-942e-5c1d8b78deb9 None None] MFA Rules not processed for user `1923e5feb96e4ceaba8aea85009a9f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:55.942310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d225c914-c0e6-4ff9-942e-5c1d8b78deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:55.994257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:56.038206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 491/995] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:46:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:46:56.325374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:46:56.326941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:56.429885 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363786bd-0428-42da-851c-6e3848d60c04 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:46:56.432708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:56.503370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:46:56.503978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:56.504254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:56.504520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:56.506102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:56.612913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:46:56.614265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf7852-a5cb-4fea-b7b5-078fdcf18334 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:46:56.632855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 505/996] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:46:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:46:59.332214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:59.332741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:59.332741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:59.334102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 492/997] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:46:59.339716 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b67d-9448-4aa6-b299-bee099919672 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:59.340157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b67d-9448-4aa6-b299-bee099919672 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:59.340252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41b67d-9448-4aa6-b299-bee099919672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:59.381339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:46:59.408380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9a41b67d-9448-4aa6-b299-bee099919672 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:46:59.409574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9a41b67d-9448-4aa6-b299-bee099919672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:59.503398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 506/998] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:46:59.786407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:46:59.787974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:59.889887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c58a-006f-4d2d-9a31-939e62d1c799 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:46:59.960190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:46:59.960710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:46:59.960980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:46:59.961242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:46:59.963091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:46:59.970752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:00.068346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:00.069756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0193-d75a-4cfb-9352-b23d63e6756d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:00.087843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 493/999] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:46:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:02.877033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:02.877554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:02.877670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:02.878957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 507/1000] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:02.884351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea934-6bc1-402e-aa60-4b126e27d136 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:02.884771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea934-6bc1-402e-aa60-4b126e27d136 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:02.885025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea934-6bc1-402e-aa60-4b126e27d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:02.960712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-13eea934-6bc1-402e-aa60-4b126e27d136 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:02.962105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-13eea934-6bc1-402e-aa60-4b126e27d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:03.024216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:03.067455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 494/1001] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:03.349672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:03.351321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:03.458181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3b448-09e0-4b91-9a06-f163a3763171 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:03.471449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:03.532575 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:03.533179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:03.533456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:03.533722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:03.535337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:03.644831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:03.646180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f51e2-a85b-436a-8094-471f18377d90 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:03.664998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 508/1002] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:05.872640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:05.873184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:05.873297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:05.874637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 495/1003] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:05.879836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac9aec-b70b-4657-8a21-4fc6ce59b7d0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:05.880237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac9aec-b70b-4657-8a21-4fc6ce59b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:05.880381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac9aec-b70b-4657-8a21-4fc6ce59b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:05.929421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:05.948498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15ac9aec-b70b-4657-8a21-4fc6ce59b7d0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:05.949624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15ac9aec-b70b-4657-8a21-4fc6ce59b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:06.050708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 509/1004] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:06.330763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:06.332334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:06.435800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99334545-8e24-4d81-8f40-8f453baf6f0d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:06.508751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:06.509344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:06.509615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:06.509879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:06.511485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:06.529221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:06.620872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:06.622715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b9efb-c5a7-4c44-8643-31faf75bcc29 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:06.640452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 496/1005] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:08.860924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:08.861452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:08.861452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:08.862736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 510/1006] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:08.868030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f17d7-78b8-429f-8741-befdfe0e3ea1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:08.868435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f17d7-78b8-429f-8741-befdfe0e3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:08.868568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f17d7-78b8-429f-8741-befdfe0e3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:08.939306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6d4f17d7-78b8-429f-8741-befdfe0e3ea1 None None] MFA Rules not processed for user `1923e5feb96e4ceaba8aea85009a9f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:08.940446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6d4f17d7-78b8-429f-8741-befdfe0e3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:09.004893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:09.036964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 497/1007] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:09.317698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:09.319236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:09.427234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecaabd-50c7-49ea-9614-e2bac95b02ee None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:09.448878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:09.506557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:09.507161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:09.507469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:09.507735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:09.509316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:09.617325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:09.618748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36a64f-6824-4d1a-b5aa-077de2b8a57a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:09.636756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 511/1008] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:12.038217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:12.038741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:12.038741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:12.040152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 498/1009] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:12.045398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b878842-30e3-4b30-8f5b-5ab2e311d98e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:12.045778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b878842-30e3-4b30-8f5b-5ab2e311d98e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:12.045938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b878842-30e3-4b30-8f5b-5ab2e311d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:12.108473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:12.112490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1b878842-30e3-4b30-8f5b-5ab2e311d98e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:12.113856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b878842-30e3-4b30-8f5b-5ab2e311d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:12.214215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 512/1010] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:12.498717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:12.500311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:12.602249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ea810-422a-44df-bb49-790d324d544c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:12.675990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:12.676584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:12.676854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:12.677115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:12.678687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:12.706719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:12.787249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:12.788962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9020f-93f9-472b-9b2e-f8f38220a39f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:12.807660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 499/1011] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:47:14.977903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9447d-b779-4654-b061-092202e78d3d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:14.978419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9447d-b779-4654-b061-092202e78d3d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:14.978419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9447d-b779-4654-b061-092202e78d3d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:14.979757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 513/1012] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:14.985557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a01e5-05e4-47d8-873e-82ab64f81f4d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:14.985981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a01e5-05e4-47d8-873e-82ab64f81f4d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:14.986098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a01e5-05e4-47d8-873e-82ab64f81f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:15.050452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0a0a01e5-05e4-47d8-873e-82ab64f81f4d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:15.051820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a0a01e5-05e4-47d8-873e-82ab64f81f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:15.124520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:15.146231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 500/1013] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:15.431936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9447d-b779-4654-b061-092202e78d3d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:15.433524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-32b9447d-b779-4654-b061-092202e78d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:15.536836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9447d-b779-4654-b061-092202e78d3d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:15.565438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:15.611495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:15.612091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:15.612372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:15.612637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:15.614215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:15.722499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:15.723974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70219-16a2-4cca-b875-84e7f1980428 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:15.741913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 514/1014] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:18.227539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:18.228067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:18.228067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:18.229421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 501/1015] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:18.234756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594503-271b-425d-b3fc-6fb2b8eda72a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:18.235213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594503-271b-425d-b3fc-6fb2b8eda72a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:18.235359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594503-271b-425d-b3fc-6fb2b8eda72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:18.300262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4d594503-271b-425d-b3fc-6fb2b8eda72a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:18.301455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4d594503-271b-425d-b3fc-6fb2b8eda72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:18.309710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:18.399320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 515/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:18.687507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:18.689038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:18.792886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca6b5-7819-4bd5-83fa-789bf3fe54af None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:18.866045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:18.866638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:18.866908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:18.867169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:18.868806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:18.905297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:18.976927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:18.978273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac66b-528c-4df8-9e9c-72dbbec860dd service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:18.995784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 502/1017] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:23.023903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:23.024404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:23.024490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:23.025758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 516/1018] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:23.031621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ca9b-5de6-4c71-9beb-52576a20a28d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:23.032044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ca9b-5de6-4c71-9beb-52576a20a28d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:23.032152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ca9b-5de6-4c71-9beb-52576a20a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:23.098483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9884ca9b-5de6-4c71-9beb-52576a20a28d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:23.099634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9884ca9b-5de6-4c71-9beb-52576a20a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:23.187959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:23.199625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 503/1019] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:47:23.486112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:23.487700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:23.590518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d29c26-ffb4-48ae-bafc-ac200a16b0db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:23.629320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:23.665157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:23.665761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:23.666042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:23.666313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:23.667929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:23.777144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:23.779050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779d094-4ffc-4c3c-ad16-18ae78c11f9e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:23.798010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 517/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:26.798422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:26.798949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:26.798949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:26.800343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 504/1021] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:26.805618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5a46-4e3c-4957-b5ac-4071ea4240a3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:26.806047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5a46-4e3c-4957-b5ac-4071ea4240a3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:26.806290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5a46-4e3c-4957-b5ac-4071ea4240a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:26.879708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-df2a5a46-4e3c-4957-b5ac-4071ea4240a3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:26.880945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-df2a5a46-4e3c-4957-b5ac-4071ea4240a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:26.900439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:26.982001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 518/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:27.263924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:27.265451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:27.370201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba720b-8bd7-40d0-926c-0106b1955af8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:27.450886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:27.451514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:27.451788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:27.452053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:27.453646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:27.497925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:27.589147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:27.592280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21734aca-3814-4f02-8060-4ee802cd4e59 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:27.612256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 505/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:32.306435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:32.306961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:32.306961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:32.308373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 519/1024] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:32.314252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1fc1-092e-4ac5-b1b1-b7e9167aca02 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:32.314687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1fc1-092e-4ac5-b1b1-b7e9167aca02 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:32.314795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d1fc1-092e-4ac5-b1b1-b7e9167aca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:32.387668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9b0d1fc1-092e-4ac5-b1b1-b7e9167aca02 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:32.388874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9b0d1fc1-092e-4ac5-b1b1-b7e9167aca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:32.483201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:32.485573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 506/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:32.766312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:32.767901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:32.870759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f2b27-17df-499d-b339-03725e620428 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:32.916471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:32.942748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:32.943307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:32.943576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:32.943843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:32.945426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:33.054139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:33.055579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791067db-c6ca-40de-bb06-727a4c7e51de service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:33.073036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 520/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:38.047624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad61d7b-a2c9-4efb-9d9e-982ad8db25d5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:38.048094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad61d7b-a2c9-4efb-9d9e-982ad8db25d5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:38.048516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad61d7b-a2c9-4efb-9d9e-982ad8db25d5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:38.051227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 507/1027] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:38.056659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055268f-9b2b-407b-9e38-b8544fd02dca None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:38.057092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055268f-9b2b-407b-9e38-b8544fd02dca None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:38.066468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055268f-9b2b-407b-9e38-b8544fd02dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:38.184921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4055268f-9b2b-407b-9e38-b8544fd02dca None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:38.186301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4055268f-9b2b-407b-9e38-b8544fd02dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:38.206247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:38.309199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 521/1028] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:47:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:42.587703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95235f-e7a1-4e55-ae1b-e7d77d3c658e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:42.588260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95235f-e7a1-4e55-ae1b-e7d77d3c658e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:42.588260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95235f-e7a1-4e55-ae1b-e7d77d3c658e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:42.590214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 508/1029] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:42.595122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fde02-291c-422d-ab97-3cdeff7b9152 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:42.595639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fde02-291c-422d-ab97-3cdeff7b9152 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:42.595743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fde02-291c-422d-ab97-3cdeff7b9152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:42.687042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ee7fde02-291c-422d-ab97-3cdeff7b9152 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:42.690734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ee7fde02-291c-422d-ab97-3cdeff7b9152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:42.770930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:42.811266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 522/1030] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:47:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:43.956608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532f05-a0d8-4bba-befe-b55544f2ebd7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:43.957117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532f05-a0d8-4bba-befe-b55544f2ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:43.957117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76532f05-a0d8-4bba-befe-b55544f2ebd7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:43.958397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 509/1031] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:43.963641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef438509-8804-4228-ac29-21a74e8038c7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:43.964026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef438509-8804-4228-ac29-21a74e8038c7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:43.964309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef438509-8804-4228-ac29-21a74e8038c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:44.044884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ef438509-8804-4228-ac29-21a74e8038c7 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:44.046145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ef438509-8804-4228-ac29-21a74e8038c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:44.152667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 523/1032] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:47:47.663984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bcd26-81dd-43bf-b92d-0fbc79db3c19 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:47.664539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bcd26-81dd-43bf-b92d-0fbc79db3c19 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:47.664539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bcd26-81dd-43bf-b92d-0fbc79db3c19 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:47.665855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 510/1033] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:47.671886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccc3e-4ef3-409b-a3cb-fd352053009a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:47.672343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccc3e-4ef3-409b-a3cb-fd352053009a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:47.674473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccc3e-4ef3-409b-a3cb-fd352053009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:47.715339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:47.749529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-95bccc3e-4ef3-409b-a3cb-fd352053009a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:47.750728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-95bccc3e-4ef3-409b-a3cb-fd352053009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:47.852811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 524/1034] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:48.161603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:48.161804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:48.162054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:48.163936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 511/1035] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 17:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:48.178440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d43e-fe84-441c-8928-bea79f96d720 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:48.178736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d43e-fe84-441c-8928-bea79f96d720 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:48.178984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d43e-fe84-441c-8928-bea79f96d720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:48.267493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5e48d43e-fe84-441c-8928-bea79f96d720 None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:48.268704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e48d43e-fe84-441c-8928-bea79f96d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:48.336748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:48.412637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 525/1036] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:48.420938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:48.423045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:48.586063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e9f0-1438-401c-a245-a65bbc4f8727 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:48.669460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:48.722140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:48.722892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:48.723177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:48.723476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:48.725325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:48.832468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:48.834084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502f60-f694-4c17-b763-b5d889489284 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:48.854411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 512/1037] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:51.233974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:51.234401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:51.234573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:51.236246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 526/1038] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:51.240967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2a380-0cab-4358-a92b-7a33c2f6b471 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:51.241357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2a380-0cab-4358-a92b-7a33c2f6b471 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:51.241595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2a380-0cab-4358-a92b-7a33c2f6b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:51.311554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c2f2a380-0cab-4358-a92b-7a33c2f6b471 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:51.312752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c2f2a380-0cab-4358-a92b-7a33c2f6b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:51.359568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:51.423417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 513/1039] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:51.713318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:51.715437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:51.904912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fd806-647e-4aea-9b96-ea04539dce31 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:51.916558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:52.036919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:52.037712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:52.038081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:52.038349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:52.040017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:52.132316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:52.133917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc13e-3544-4e6a-8b24-678ca8731e07 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:52.153304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 527/1040] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:47:54.690505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5d858-42e0-43b0-bf81-c457fa32c82e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:54.691525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5d858-42e0-43b0-bf81-c457fa32c82e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:54.692034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5d858-42e0-43b0-bf81-c457fa32c82e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:54.694170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 514/1041] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:54.700332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966835f-9f3a-468d-aeeb-51d87a37a335 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:54.700796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966835f-9f3a-468d-aeeb-51d87a37a335 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:54.701065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966835f-9f3a-468d-aeeb-51d87a37a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:54.717841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:54.771440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5966835f-9f3a-468d-aeeb-51d87a37a335 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:54.772802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5966835f-9f3a-468d-aeeb-51d87a37a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:54.876232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 528/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:55.168389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:55.168788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:55.169158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:55.170906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 515/1043] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 17:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:55.176293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ec87-4d21-4689-8b26-f4029a973a2a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:55.176747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ec87-4d21-4689-8b26-f4029a973a2a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:55.177177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ec87-4d21-4689-8b26-f4029a973a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:55.256300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0a51ec87-4d21-4689-8b26-f4029a973a2a None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:55.257502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a51ec87-4d21-4689-8b26-f4029a973a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:55.295077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:55.389733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 529/1044] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:55.398252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:55.400128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:55.563524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958bd3d-843e-41b9-adf5-b7b1c442f5a1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:55.585315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:55.690956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:55.691874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:55.692292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:55.692569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:55.694852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:55.796300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:55.797905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcc03b-1b20-4dac-82e9-3eaa0a88a8fc service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:55.817240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca985fa-7d20-422e-a238-f2897611fbae None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:55.817748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca985fa-7d20-422e-a238-f2897611fbae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:55.817748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca985fa-7d20-422e-a238-f2897611fbae None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:55.819069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 530/1045] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:47:55.820773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 516/1046] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:55.825210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82966945-ffa9-47b5-8f33-a6c22f30ae49 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:55.825509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82966945-ffa9-47b5-8f33-a6c22f30ae49 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:55.825786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82966945-ffa9-47b5-8f33-a6c22f30ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:55.900953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-82966945-ffa9-47b5-8f33-a6c22f30ae49 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:55.902292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-82966945-ffa9-47b5-8f33-a6c22f30ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:56.015447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:56.027327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 531/1047] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:56.359776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:56.359776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:56.359776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:56.362376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 517/1048] 10.222.0.26 () {54 vars in 963 bytes} [Fri Oct 14 17:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:56.366049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cfbc-21d3-4e1a-9e2a-8dba7921ab36 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:56.366200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cfbc-21d3-4e1a-9e2a-8dba7921ab36 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:56.366381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785cfbc-21d3-4e1a-9e2a-8dba7921ab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:56.451758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6785cfbc-21d3-4e1a-9e2a-8dba7921ab36 None None] MFA Rules not processed for user `fdb70aefb254402ea472c80b81124cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:56.453098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6785cfbc-21d3-4e1a-9e2a-8dba7921ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:56.535726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 532/1049] 10.222.0.26 () {58 vars in 1060 bytes} [Fri Oct 14 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:47:56.543406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:56.544927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:56.576665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:56.658075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c23a62-4a13-411a-a350-53b9cd6dd9e8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:56.746401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:56.747047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:56.747393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:56.747656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:56.749445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:56.858474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:56.902586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:56.904298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a8cc7-e65f-4436-b2f3-57ced494313e service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:56.937215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 518/1050] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:47:58.085979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:58.086512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:58.086512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:58.088156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 533/1051] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:47:58.094159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8d0d-b88e-4e22-9505-374127b27e67 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:58.095143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8d0d-b88e-4e22-9505-374127b27e67 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:58.095682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8d0d-b88e-4e22-9505-374127b27e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:58.172618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-471c8d0d-b88e-4e22-9505-374127b27e67 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:47:58.173821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-471c8d0d-b88e-4e22-9505-374127b27e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:58.273552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 519/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:47:58.569898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:47:58.571465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:58.664119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:58.730200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6ee81-0797-4204-bfe9-f0701b6877da None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:47:58.847307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:47:58.848000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:47:58.848278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:47:58.848542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:47:58.850198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:47:58.902867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:47:58.947338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:47:58.949549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5807-6da4-439c-a172-4aeee76812fa service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:47:58.968906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 534/1053] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:01.211190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:01.211750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:01.211750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:01.213361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 520/1054] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:01.218974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71df0-1ccb-4b0c-bffa-c7cd2e80f024 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:01.219485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71df0-1ccb-4b0c-bffa-c7cd2e80f024 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:01.219567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e71df0-1ccb-4b0c-bffa-c7cd2e80f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:01.292737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d9e71df0-1ccb-4b0c-bffa-c7cd2e80f024 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:01.293921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d9e71df0-1ccb-4b0c-bffa-c7cd2e80f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:01.393860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 535/1055] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:01.691924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:01.693413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:01.733291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:01.845893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593382-74f8-450b-977a-edb4a5ad82dc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:01.957463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:01.963832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:01.964868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:01.965496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:01.965761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:01.967400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:02.062865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:02.064600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f8562-5b8c-470d-8e70-62686d126670 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:02.083628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 521/1056] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:04.311734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:04.312251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:04.312447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:04.313757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 536/1057] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:04.318805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115218e5-a7db-4ed4-905f-90900d523e1f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:04.319187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115218e5-a7db-4ed4-905f-90900d523e1f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:04.319448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115218e5-a7db-4ed4-905f-90900d523e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:04.439925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-115218e5-a7db-4ed4-905f-90900d523e1f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:04.442062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-115218e5-a7db-4ed4-905f-90900d523e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:04.520403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:04.555975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 522/1058] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:04.846627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:04.848169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:04.878394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:04.994907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c74d-9715-4429-b4fc-0160b2b76b37 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:05.092633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:05.109549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:05.110177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:05.110450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:05.110715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:05.112381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:05.202680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:05.204313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca62c-767f-4b36-a1d5-2bd5692b3dd4 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:05.222843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 537/1059] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:07.673188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:07.673750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:07.673750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:07.675105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 523/1060] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:07.680453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d65876-e0a7-4ba9-ba57-01b71e0cc2bc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:07.680892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d65876-e0a7-4ba9-ba57-01b71e0cc2bc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:07.681282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d65876-e0a7-4ba9-ba57-01b71e0cc2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:07.749899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-81d65876-e0a7-4ba9-ba57-01b71e0cc2bc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:07.751117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-81d65876-e0a7-4ba9-ba57-01b71e0cc2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:07.810596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:07.851377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 538/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:08.142074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:08.143631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:08.291845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e69d7-5489-487e-8918-35b6f542f8e5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:08.348013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:08.415100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:08.415733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:08.416012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:08.416279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:08.418751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:08.509635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:08.511835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c2ab5-bd77-413a-b57a-cf9e27215ca2 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:08.530153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 524/1062] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:48:10.845724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:10.846342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:10.846342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:10.847655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 539/1063] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:10.852814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3bfb-52c0-43fe-8f44-b525f5588819 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:10.853245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3bfb-52c0-43fe-8f44-b525f5588819 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:10.853475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3bfb-52c0-43fe-8f44-b525f5588819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:10.921032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-194f3bfb-52c0-43fe-8f44-b525f5588819 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:10.922230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-194f3bfb-52c0-43fe-8f44-b525f5588819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:10.930595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:11.030127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 525/1064] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:11.317656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:11.319873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:11.480761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e8d83-acb9-4c29-823a-882def1427a1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:11.527521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:11.596179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:11.596699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:11.596970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:11.597231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:11.598845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:11.692888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:11.694477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3775477-6457-478a-bc6f-6a155e5aee31 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:11.713411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 540/1065] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:14.002733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689106-0135-4104-b425-69db077eb993 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:14.003258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689106-0135-4104-b425-69db077eb993 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:14.003258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689106-0135-4104-b425-69db077eb993 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:14.004774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 526/1066] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:14.010184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4328-1606-4d48-a757-b0c412aa3439 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:14.010643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4328-1606-4d48-a757-b0c412aa3439 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:14.010803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4328-1606-4d48-a757-b0c412aa3439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:14.077461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:14.080586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-99dc4328-1606-4d48-a757-b0c412aa3439 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:14.082509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99dc4328-1606-4d48-a757-b0c412aa3439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:14.184989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 541/1067] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:14.474092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689106-0135-4104-b425-69db077eb993 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:14.476095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4c689106-0135-4104-b425-69db077eb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:14.624388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:14.633186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689106-0135-4104-b425-69db077eb993 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:14.763621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:14.764304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:14.764645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:14.764992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:14.767055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:14.880962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:14.883011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34e0ab-3022-4830-b56b-014810067a4e service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:14.899194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:14.904858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 527/1068] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:17.141049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb1c8c-19df-4a81-a9d3-f401f96973a8 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.141609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb1c8c-19df-4a81-a9d3-f401f96973a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.141609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb1c8c-19df-4a81-a9d3-f401f96973a8 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.142954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 542/1069] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:17.148476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f9725-56e9-4984-ac89-fb3f7c20e5ad None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.148891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f9725-56e9-4984-ac89-fb3f7c20e5ad None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.148996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f9725-56e9-4984-ac89-fb3f7c20e5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.220516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-779f9725-56e9-4984-ac89-fb3f7c20e5ad None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:17.221767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-779f9725-56e9-4984-ac89-fb3f7c20e5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:17.319514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.319803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.320076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.321552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 528/1070] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:17.321688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 543/1071] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:48:17.326938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e23-8ef2-477c-846d-fd4be804fc8c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.327222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e23-8ef2-477c-846d-fd4be804fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.327528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e23-8ef2-477c-846d-fd4be804fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.393018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-334a7e23-8ef2-477c-846d-fd4be804fc8c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:17.394114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-334a7e23-8ef2-477c-846d-fd4be804fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:17.423291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:17.493648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 529/1072] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:17.618545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:17.620371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:17.753963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:17.777348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f988f0-6112-4514-a493-3da563545ad7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:17.793633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c64ac-baee-4948-ad38-a2d71b77c77f None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.793918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c64ac-baee-4948-ad38-a2d71b77c77f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.794190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c64ac-baee-4948-ad38-a2d71b77c77f None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.795576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 530/1073] 10.222.0.26 () {54 vars in 962 bytes} [Fri Oct 14 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:48:17.800539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.800817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.801088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.878728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] MFA Rules not processed for user `00b73010bdce438b846bd93f8a511634`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:17.879971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:17.894408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:17.895028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:17.895302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:17.895589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:17.897201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:17.962463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 531/1074] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Oct 14 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:48:17.971541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:17.978968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639dc07-9777-4efb-93e9-3c83eb862869 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:17.989572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:17.991173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc1e38-c948-48f5-ba48-d21ac1444b6e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:17.995592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:17.997465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:18.011204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 544/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:18.058039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:18.058634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:18.058899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:18.059158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:18.060769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:18.189415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:18.190874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e0119-1809-426f-ae98-94e8d726b155 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:18.210819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 532/1076] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:48:18.964762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b63a1-0e82-46fb-ac4c-1d6c036d469b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:18.965289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b63a1-0e82-46fb-ac4c-1d6c036d469b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:18.965289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b63a1-0e82-46fb-ac4c-1d6c036d469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:19.031826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-947b63a1-0e82-46fb-ac4c-1d6c036d469b None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:19.033035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-947b63a1-0e82-46fb-ac4c-1d6c036d469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:19.121446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 545/1077] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:48:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:19.166171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:19.167044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:19.167401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:19.168964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 533/1078] 10.222.0.26 () {54 vars in 943 bytes} [Fri Oct 14 17:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:19.175574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcfe6-4eea-43f4-be08-f8d33f8457e4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:19.175921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcfe6-4eea-43f4-be08-f8d33f8457e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:19.176253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bcfe6-4eea-43f4-be08-f8d33f8457e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:19.251507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ea5bcfe6-4eea-43f4-be08-f8d33f8457e4 None None] MFA Rules not processed for user `565161def47f4b29a23f10fce8783d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:19.252690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea5bcfe6-4eea-43f4-be08-f8d33f8457e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:19.273654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:19.362328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 546/1079] 10.222.0.26 () {58 vars in 1040 bytes} [Fri Oct 14 17:48:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:48:19.372064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:19.373720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:19.424244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:19.508445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c946df-f277-446b-9f13-3a6189947c8b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:19.618614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:19.619222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:19.619535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:19.620319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:19.621963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:19.656717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:19.712490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:19.714289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6418726-9c87-48ba-a295-261a8c1c3771 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:19.722686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 534/1080] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:48:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:48:20.265556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:20.266143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:20.266143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:20.267654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 547/1081] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:20.272955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c02d8-f19b-4723-b32e-e2c683ab06fc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:20.273244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c02d8-f19b-4723-b32e-e2c683ab06fc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:20.273516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c02d8-f19b-4723-b32e-e2c683ab06fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:20.355786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9e4c02d8-f19b-4723-b32e-e2c683ab06fc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:20.357156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e4c02d8-f19b-4723-b32e-e2c683ab06fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:20.474508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 535/1082] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:20.776909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:20.778417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:20.923473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:20.930612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7710f1-6da1-407a-8dd8-247d5835204e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:21.056694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:21.057853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:21.058128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:21.058395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:21.060032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:21.161399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:21.163162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8f09-13cc-4ecc-b5fb-19a490861cb9 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:21.177162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:21.186898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 548/1083] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:23.386463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:23.387018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:23.387018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:23.388377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 536/1084] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:23.393672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0aed-fd6a-4a35-90cc-b98e2bc5136f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:23.394099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0aed-fd6a-4a35-90cc-b98e2bc5136f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:23.394184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0aed-fd6a-4a35-90cc-b98e2bc5136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:23.473701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9fdf0aed-fd6a-4a35-90cc-b98e2bc5136f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:23.474915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9fdf0aed-fd6a-4a35-90cc-b98e2bc5136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:23.582491 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 549/1085] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:23.874665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:23.876018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:23.909009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:24.046718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23b464-31aa-4cda-8c76-59e347b4a8e8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:24.160595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:24.178722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:24.179477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:24.179829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:24.180134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:24.181785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:24.282056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:24.283694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861033-57b0-4d43-9493-6872dc8789e2 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:24.306745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 537/1086] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:33.580509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=66 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:34.303561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=51 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:42.686569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31caa85-d6d4-4566-8df3-c782549ca953 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:42.687142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31caa85-d6d4-4566-8df3-c782549ca953 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:42.687142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31caa85-d6d4-4566-8df3-c782549ca953 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:42.688807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 550/1087] 10.222.0.26 () {54 vars in 918 bytes} [Fri Oct 14 17:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:42.693848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339701b-c2ff-4a0d-a740-be093e39d4d9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:42.694251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339701b-c2ff-4a0d-a740-be093e39d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:42.694390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339701b-c2ff-4a0d-a740-be093e39d4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:42.770746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9339701b-c2ff-4a0d-a740-be093e39d4d9 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:42.771976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9339701b-c2ff-4a0d-a740-be093e39d4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:42.878109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 538/1088] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Oct 14 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:42.892573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af93c-deaa-41e1-bcbf-35c445b0fd77 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:42.892860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af93c-deaa-41e1-bcbf-35c445b0fd77 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:42.893132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af93c-deaa-41e1-bcbf-35c445b0fd77 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:42.894494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 551/1089] 10.222.0.26 () {54 vars in 918 bytes} [Fri Oct 14 17:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:42.899092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f026c-3771-4602-967b-3e5ee3e3a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:42.899411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f026c-3771-4602-967b-3e5ee3e3a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:42.899684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f026c-3771-4602-967b-3e5ee3e3a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:42.972723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:42.975126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8d1f026c-3771-4602-967b-3e5ee3e3a2c4 None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:42.977069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d1f026c-3771-4602-967b-3e5ee3e3a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:43.091086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 539/1090] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Oct 14 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:45.675114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:45.675721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:45.675721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:45.677027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 552/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:45.682446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13884d2-ae4c-43bf-8f12-6729ea626005 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:45.682893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13884d2-ae4c-43bf-8f12-6729ea626005 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:45.683574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13884d2-ae4c-43bf-8f12-6729ea626005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:45.749204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f13884d2-ae4c-43bf-8f12-6729ea626005 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:45.750394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f13884d2-ae4c-43bf-8f12-6729ea626005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:45.805122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:45.848323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 540/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:46.142958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:46.144548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:46.293495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33cc1d-f888-4e8c-b512-0be17a3d8903 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:46.369694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:46.410253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:46.410807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:46.411075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:46.411363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:46.413364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:46.500871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:46.502455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d8e62-153d-45c5-af22-b2e1af33c84e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:46.520196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 553/1093] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:47.662509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:47.663036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:47.663036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:47.664415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 541/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:47.671532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7c40-3016-47b5-bb4d-16080b933a7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:47.672056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7c40-3016-47b5-bb4d-16080b933a7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:47.672156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7c40-3016-47b5-bb4d-16080b933a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:47.748505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bf7a7c40-3016-47b5-bb4d-16080b933a7b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:47.749719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bf7a7c40-3016-47b5-bb4d-16080b933a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:47.776483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:47.847523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 554/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:48.001607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:48.003124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:48.146018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc1004-5249-4c4f-8fcc-f04a573e487c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:48.185628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:48.256899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:48.257497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:48.257765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:48.258026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:48.259645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:48.350047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:48.351667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79bc62-027d-4835-b73d-a3162f7d0518 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:48.369565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 542/1096] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:49.499266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:49.499879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:49.499879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:49.501172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 555/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:49.507251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc8a0-22ce-480d-bfa5-88d5420dc74a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:49.507740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc8a0-22ce-480d-bfa5-88d5420dc74a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:49.507834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbc8a0-22ce-480d-bfa5-88d5420dc74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:49.563112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:49.586618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9efbc8a0-22ce-480d-bfa5-88d5420dc74a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:49.588092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9efbc8a0-22ce-480d-bfa5-88d5420dc74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:49.682575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 543/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:48:49.831870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:49.833459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:49.977882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2e5ec-6e2f-4325-b444-497fd22c364d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:49.989653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:50.092258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:50.092783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:50.093058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:50.093324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:50.094912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:50.188704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:50.190298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdcf29-6a2c-4c21-8447-98c9b0700e97 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:50.210274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 556/1099] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:51.318031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:51.318665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:51.318665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:51.320004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 544/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:51.326633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f89c-3a98-496d-aeb0-60f7b2c70ea5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:51.327106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f89c-3a98-496d-aeb0-60f7b2c70ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:51.327206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f89c-3a98-496d-aeb0-60f7b2c70ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:51.346725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:51.403506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3249f89c-3a98-496d-aeb0-60f7b2c70ea5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:51.404834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3249f89c-3a98-496d-aeb0-60f7b2c70ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:51.500331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 557/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:51.649948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:51.651431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:51.762437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:51.798656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8abf-bd6b-4756-8caa-881a220730d7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:51.916693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:51.917208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:51.917485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:51.917796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:51.919437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:51.995158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:52.009072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:52.010661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58775060-20aa-4a2b-804a-38c251df238d service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:52.029412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 545/1102] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:53.138674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:53.139240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:53.139240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:53.140576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 558/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:53.146754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561ff-c7fa-41c3-b84f-ddd3690b9ac2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:53.147168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561ff-c7fa-41c3-b84f-ddd3690b9ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:53.147304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac561ff-c7fa-41c3-b84f-ddd3690b9ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:53.223569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2ac561ff-c7fa-41c3-b84f-ddd3690b9ac2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:53.224767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2ac561ff-c7fa-41c3-b84f-ddd3690b9ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:53.320376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 546/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:53.470949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:53.472420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:53.555816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:53.618095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3482bb-588c-41e4-8256-ed4f00ebe86d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:53.736131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:53.736671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:53.736947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:53.737213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:53.738804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:53.787522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:53.829062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:53.830624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ce0b-3873-4db9-a980-242486e22c13 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:53.849089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 559/1105] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:54.907544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:54.908135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:54.908135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:54.909428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 547/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:54.915844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755722c5-7446-4a4e-badd-2c2901dea254 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:54.916291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755722c5-7446-4a4e-badd-2c2901dea254 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:54.916395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755722c5-7446-4a4e-badd-2c2901dea254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:54.990593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-755722c5-7446-4a4e-badd-2c2901dea254 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:54.991729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-755722c5-7446-4a4e-badd-2c2901dea254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:55.085921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 560/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:55.237064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:55.238564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:55.286075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:55.381733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f93ae-298f-4c4d-a9c3-74186cbb8169 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:55.494948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:55.495580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:55.495917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:55.496287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:55.497898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:55.504725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:55.587889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:55.589898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007dc3e-e584-4f46-8196-f7c0f7f87f74 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:55.608382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 548/1108] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:56.654853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:56.655435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:56.655435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:56.656814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 561/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:56.662915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb7c2-b9c9-480e-8e7c-5ed123997216 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:56.663343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb7c2-b9c9-480e-8e7c-5ed123997216 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:56.663484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb7c2-b9c9-480e-8e7c-5ed123997216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:56.741523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3c7eb7c2-b9c9-480e-8e7c-5ed123997216 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:56.742707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3c7eb7c2-b9c9-480e-8e7c-5ed123997216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:56.807684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:56.837510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 549/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:56.988096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:56.989565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:57.007172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:57.138826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05641a8-511a-4456-a8e7-2e0cdd476b1b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:57.226912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:57.253113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:57.253643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:57.253913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:57.254176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:57.255786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:57.343379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:57.344959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f773fc-7b9f-4ed3-9fe6-6ef5807aee9a service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:57.362291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 562/1111] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:48:58.425496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:58.426032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:58.426032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:58.427412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 550/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:48:58.434821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263327d-1862-4bba-a058-09f95029c166 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:58.435516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263327d-1862-4bba-a058-09f95029c166 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:58.435516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263327d-1862-4bba-a058-09f95029c166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:58.515490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9263327d-1862-4bba-a058-09f95029c166 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:48:58.516747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9263327d-1862-4bba-a058-09f95029c166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:58.557540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:58.616154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 563/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:48:58.768448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:48:58.770029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:58.923024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32230d-8053-4222-9497-c63a2f57c631 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:48:58.979452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:48:59.039668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:48:59.040297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:48:59.040571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:48:59.040833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:48:59.042869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:48:59.132041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:48:59.133640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d9c1-4b60-49f2-b182-4f2a02326746 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:48:59.152765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 551/1114] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:00.214114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:00.215145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:00.215396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:00.216805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 564/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:00.223136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c7c58-cefc-49be-8187-35deca21e79c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:00.223598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c7c58-cefc-49be-8187-35deca21e79c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:00.223703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c7c58-cefc-49be-8187-35deca21e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:00.298344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8f9c7c58-cefc-49be-8187-35deca21e79c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:00.299594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8f9c7c58-cefc-49be-8187-35deca21e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:00.301603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:00.396399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 552/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:00.547370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:00.548904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:00.693923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9af380-dad2-485b-8be1-907b911d258e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:00.722947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:00.807728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:00.808804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:00.809157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:00.809430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:00.811036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:00.901303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:00.903161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f5a75-deda-4fc5-98d7-24570d527347 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:00.921493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 565/1117] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:02.974864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:02.975438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:02.975438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:02.976745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 553/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:02.982110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca967d-82fd-4507-8af0-7329df0e9cf4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:02.982533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca967d-82fd-4507-8af0-7329df0e9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:02.982638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca967d-82fd-4507-8af0-7329df0e9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:03.024102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:03.049506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8fca967d-82fd-4507-8af0-7329df0e9cf4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:03.050707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8fca967d-82fd-4507-8af0-7329df0e9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:03.144895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 566/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:03.431998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:03.434342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:03.537019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f367b-7254-4efa-a4a8-74b5fc6c4b64 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:03.568786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:03.611675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:03.612270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:03.612539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:03.612801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:03.614390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:03.724955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:03.726395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e6da-5d1a-454c-af55-4ffc77012902 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:03.745055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 554/1120] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:06.079513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:06.080076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:06.080076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:06.081469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:06.086778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54180-016b-44f0-9ccb-6e08bc34fcc4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:06.087457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54180-016b-44f0-9ccb-6e08bc34fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:06.087672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54180-016b-44f0-9ccb-6e08bc34fcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:06.162695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-10e54180-016b-44f0-9ccb-6e08bc34fcc4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:06.163903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-10e54180-016b-44f0-9ccb-6e08bc34fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:06.176437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:06.261304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:06.547753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:06.549287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:06.651845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaa640-91eb-4d90-b65a-8cb03283725d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:06.664703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:06.727671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:06.728272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:06.728549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:06.728815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:06.730434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:06.837836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:06.839511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de600f62-6c0d-457c-8288-74744946ca98 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:06.858158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 568/1123] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:09.366393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:09.366965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:09.366965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:09.368357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:09.374468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f397-baa2-46e8-9092-1a0bb2ad2647 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:09.374891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f397-baa2-46e8-9092-1a0bb2ad2647 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:09.374998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f397-baa2-46e8-9092-1a0bb2ad2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:09.422672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:09.441147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8c07f397-baa2-46e8-9092-1a0bb2ad2647 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:09.442353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8c07f397-baa2-46e8-9092-1a0bb2ad2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:09.539482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:09.848022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:09.849571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:09.952067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30aef3-cfc1-4652-a1b4-e96d163bf006 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:09.991229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:10.025273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:10.025873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:10.026174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:10.026437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:10.028046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:10.136176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:10.137606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf15e1c-3c99-4dd1-ad6f-edd730b076f5 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:10.155245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 557/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:12.425469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:12.426021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:12.426021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:12.427362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:12.433677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce50bf-1405-4d08-9d18-6e62104f0f01 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:12.434107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce50bf-1405-4d08-9d18-6e62104f0f01 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:12.434209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce50bf-1405-4d08-9d18-6e62104f0f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:12.500139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-adce50bf-1405-4d08-9d18-6e62104f0f01 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:12.501334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-adce50bf-1405-4d08-9d18-6e62104f0f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:12.521883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:12.597034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:12.883188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:12.884764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:12.987950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ba3a-8a6f-498b-85ad-ce1d6c9b456e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:13.008185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:13.061764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:13.062364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:13.062643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:13.062913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:13.064546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:13.172353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:13.173763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160801a-973a-4cc7-af5c-318472d845f1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:13.191454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 571/1129] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:15.454508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:15.455065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:15.455065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:15.456464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:15.462240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cf18-a096-4acd-8a46-6cb78b59c6fa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:15.462656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cf18-a096-4acd-8a46-6cb78b59c6fa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:15.462788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cf18-a096-4acd-8a46-6cb78b59c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:15.526598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:15.529557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9796cf18-a096-4acd-8a46-6cb78b59c6fa None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:15.531086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9796cf18-a096-4acd-8a46-6cb78b59c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:15.627465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:15.918432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:15.920052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:16.025135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbddd24-322f-47e5-a0db-6a41e913877d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:16.075462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:16.099893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:16.100489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:16.100762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:16.101029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:16.102621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:16.212131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:16.214140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5c0e6-4cfd-461e-ae42-7a150b12cf9b service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:16.231675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 560/1132] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:18.452622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:18.453216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:18.453216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:18.454516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:18.459907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4942e5-a5ef-4a67-bd1b-796552fff569 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:18.460345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4942e5-a5ef-4a67-bd1b-796552fff569 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:18.460479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4942e5-a5ef-4a67-bd1b-796552fff569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:18.527387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1a4942e5-a5ef-4a67-bd1b-796552fff569 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:18.528594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1a4942e5-a5ef-4a67-bd1b-796552fff569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:18.558131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:18.625690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:18.910381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:18.911985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:19.014788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ae47b-c746-4593-89f2-da425eaa903f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:19.043327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:19.088122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:19.088719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:19.088993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:19.089259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:19.090846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:19.205535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:19.206954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22964848-362b-4339-a7c4-7b09577af532 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:19.225048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 574/1135] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:49:21.432218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:21.432945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:21.432945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:21.434351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:21.440356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177058d7-d76c-49cc-b2c5-3a1c9063a687 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:21.440744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177058d7-d76c-49cc-b2c5-3a1c9063a687 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:21.440909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177058d7-d76c-49cc-b2c5-3a1c9063a687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:21.507341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-177058d7-d76c-49cc-b2c5-3a1c9063a687 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:21.508779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-177058d7-d76c-49cc-b2c5-3a1c9063a687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:21.517063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:21.605510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:21.889014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:21.890535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:21.991358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7080-17e4-4de9-82a0-6a928ea19488 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:22.049410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:22.067321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:22.067919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:22.068190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:22.068449 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:22.070025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:22.176467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:22.177884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809634c5-1bf2-47f2-b304-39a9788d7c4f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:22.195296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 563/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:24.382763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:24.383364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:24.383364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:24.384827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:24.390139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89e5e-d0b5-424d-a271-2e6325cf0631 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:24.390566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89e5e-d0b5-424d-a271-2e6325cf0631 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:24.390686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89e5e-d0b5-424d-a271-2e6325cf0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:24.457642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8bd89e5e-d0b5-424d-a271-2e6325cf0631 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:24.458827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8bd89e5e-d0b5-424d-a271-2e6325cf0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:24.497112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:24.554571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:24.835116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:24.836936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:24.940895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e724-6730-42b2-a479-d1fd2ed4be25 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:24.979015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:25.014926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:25.015560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:25.015838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:25.016107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:25.017704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:25.124879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:25.126295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e68fd-d8ba-47f4-b6fa-22603c6d2721 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:25.144727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 577/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:27.362315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:27.363093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:27.363093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:27.364360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:49:27.370569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a50fdd-e8fd-4c05-a125-4324b8ad027c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:27.371042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a50fdd-e8fd-4c05-a125-4324b8ad027c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:27.371585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a50fdd-e8fd-4c05-a125-4324b8ad027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:27.454806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e9a50fdd-e8fd-4c05-a125-4324b8ad027c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:27.456053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e9a50fdd-e8fd-4c05-a125-4324b8ad027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:27.479094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:27.566553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:27.852284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:27.854434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:27.961092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e55cf-3a13-4290-bf06-91e9d4b9c0be None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:28.029144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:28.036369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:28.036972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:28.037249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:28.037520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:28.039144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:28.151324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:28.152758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020877-684b-44f3-a2e7-ff886494a3b3 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:28.170772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 566/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:30.327126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:30.327720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:30.327720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:30.329097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:30.334339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7b93-7820-4048-b9c4-9b2817eb836d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:30.334749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7b93-7820-4048-b9c4-9b2817eb836d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:30.334884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7b93-7820-4048-b9c4-9b2817eb836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:30.401032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2acc7b93-7820-4048-b9c4-9b2817eb836d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:30.402469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2acc7b93-7820-4048-b9c4-9b2817eb836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:30.451548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:30.499877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:49:30.780388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:30.781936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:30.883612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc683d-3b42-4092-ba1e-3f953b500fa1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:30.932262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:30.958351 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:30.958952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:30.959227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:30.959520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:30.961111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:31.068457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:31.069801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909f659-d683-4690-9c53-1e4598816417 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:31.088928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 580/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:40.498290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=22 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:41.085773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=66 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:51.267776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a4d7-88cb-4105-90e8-4f4269bed687 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:51.268346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a4d7-88cb-4105-90e8-4f4269bed687 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:51.268346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7a4d7-88cb-4105-90e8-4f4269bed687 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:51.269734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 568/1148] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:51.275936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ae86-7912-4c85-8fae-df8f15fc3851 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:51.276374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ae86-7912-4c85-8fae-df8f15fc3851 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:51.276486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ae86-7912-4c85-8fae-df8f15fc3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:51.341452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2ac4ae86-7912-4c85-8fae-df8f15fc3851 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:51.342639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2ac4ae86-7912-4c85-8fae-df8f15fc3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:51.438708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 581/1149] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:49:51.748105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:51.748383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:51.748650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:51.750104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 569/1150] 10.222.0.26 () {54 vars in 962 bytes} [Fri Oct 14 17:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:51.755324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be640-ec8d-44e8-8ea5-261b1741d6c5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:51.755593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be640-ec8d-44e8-8ea5-261b1741d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:51.755862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622be640-ec8d-44e8-8ea5-261b1741d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:51.832720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-622be640-ec8d-44e8-8ea5-261b1741d6c5 None None] MFA Rules not processed for user `00b73010bdce438b846bd93f8a511634`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:51.834131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-622be640-ec8d-44e8-8ea5-261b1741d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:51.856518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:51.912420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 582/1151] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Oct 14 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:51.920416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:51.921923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:52.022861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8149ff6-7ec0-4357-ba8c-72b8d88f2afd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:52.095180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:52.095809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:52.096089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:52.096376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:52.097970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:52.150953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:52.204317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:52.205742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541826d-994a-4a31-8853-8f28f8166463 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:52.224631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 570/1152] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:49:54.469293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:54.469918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:54.469918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:54.471154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 583/1153] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:54.476398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aaf03-17a9-45d5-9ff9-97b652e7f885 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:54.476965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aaf03-17a9-45d5-9ff9-97b652e7f885 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:54.476965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aaf03-17a9-45d5-9ff9-97b652e7f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:54.542908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-707aaf03-17a9-45d5-9ff9-97b652e7f885 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:54.544136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-707aaf03-17a9-45d5-9ff9-97b652e7f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:54.639366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 571/1154] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:49:54.910997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:54.912579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:55.038406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeaac0-205c-41db-bb78-24cfcf9ff3d7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:55.087286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:55.131578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:55.132172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:55.132473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:55.132733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:55.133362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:55.134431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:49:55.134431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:49:55.134431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:49:55.135585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3da5cf-047c-4f9e-96b9-a2f118f17a71 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:55.153829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 584/1155] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Oct 14 17:49:54 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:49:57.364824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:57.365380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:57.365380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:57.366737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 572/1156] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:49:57.372078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5e98-3bd5-47ca-b715-d64dd0a70464 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:57.372514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5e98-3bd5-47ca-b715-d64dd0a70464 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:57.372646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5e98-3bd5-47ca-b715-d64dd0a70464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:57.439226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1a7b5e98-3bd5-47ca-b715-d64dd0a70464 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:49:57.440441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1a7b5e98-3bd5-47ca-b715-d64dd0a70464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:57.535914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 585/1157] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:49:57.840207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:49:57.841727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:57.852065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:57.987609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f828628-1101-4ba8-b2d5-564281ce27d3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:49:58.066109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:49:58.098390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:49:58.098987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:49:58.099267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:49:58.099566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:49:58.101738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:49:58.189711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:49:58.191316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd170b-9071-4441-919c-2db3f4edb0f8 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:49:58.209015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 573/1158] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:50:00.549359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:00.549903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:00.549903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:00.551294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 586/1159] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:50:00.557303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c24-ecae-49cc-8300-035e4d986124 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:00.557710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c24-ecae-49cc-8300-035e4d986124 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:00.557844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2c24-ecae-49cc-8300-035e4d986124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:00.624541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-021b2c24-ecae-49cc-8300-035e4d986124 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:50:00.625754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-021b2c24-ecae-49cc-8300-035e4d986124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:00.670953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:00.725415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 574/1160] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:50:01.020319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:50:01.021870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:01.045900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:01.129296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c8a42-b039-48c3-9943-952819cd1399 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:50:01.202658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:50:01.203260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:01.203566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:01.203835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:01.205441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:01.278956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:01.313666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:50:01.315088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ebab8-5dda-4f9c-9140-3895cc79ef2a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:50:01.332791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 587/1161] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:50:03.546617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:03.547185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:03.547185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:03.548531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 575/1162] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:50:03.554448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62141-dac3-4052-9bc9-8b167c182c41 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:03.554916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62141-dac3-4052-9bc9-8b167c182c41 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:03.555063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62141-dac3-4052-9bc9-8b167c182c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:03.620450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-18b62141-dac3-4052-9bc9-8b167c182c41 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:50:03.621649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-18b62141-dac3-4052-9bc9-8b167c182c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:03.717458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 588/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:50:04.009450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:50:04.011034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:04.113880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb1b9d-afde-477a-a259-fef88aae6eaa None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:50:04.185370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:04.186767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:50:04.187459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:04.187912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:04.188345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:04.190117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:04.299858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:50:04.301283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9964b9-30b4-43a5-80d4-478f79eda54c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:50:04.319301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 576/1164] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:50:06.591676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:06.592246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:06.592246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:06.593637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 589/1165] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:50:06.598953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6368-459b-4917-8c2d-ef8c6f5fd18d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:06.599441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6368-459b-4917-8c2d-ef8c6f5fd18d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:06.599536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f6368-459b-4917-8c2d-ef8c6f5fd18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:06.664909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c64f6368-459b-4917-8c2d-ef8c6f5fd18d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:50:06.666106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c64f6368-459b-4917-8c2d-ef8c6f5fd18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:06.720515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:06.764669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 577/1166] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:50:07.057064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:50:07.058604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:07.097292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:07.171907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d3d7-6335-4fcc-a02e-bb2e3d940e10 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:50:07.245912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:50:07.246675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:07.246954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:07.247223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:07.248908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:07.330820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:07.359681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:50:07.361097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82b7cc-dd03-4ddf-b9ea-dd7a05dd6cd1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:50:07.379717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 590/1167] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:50:09.712418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:09.712879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:09.712982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:09.714294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 578/1168] 10.222.0.26 () {54 vars in 927 bytes} [Fri Oct 14 17:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:50:09.719807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeba4d-6d07-4580-a1d8-6049dabe5668 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:09.720262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeba4d-6d07-4580-a1d8-6049dabe5668 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:09.720358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeba4d-6d07-4580-a1d8-6049dabe5668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:09.786253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-47eeba4d-6d07-4580-a1d8-6049dabe5668 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:50:09.787484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47eeba4d-6d07-4580-a1d8-6049dabe5668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:09.883900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 591/1169] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Oct 14 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:50:10.171720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:50:10.173445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:10.283353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515aaf1-ed54-4935-bbfb-d3382a77e2be None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:50:10.360398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:50:10.360986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:50:10.361262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:50:10.361526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:50:10.363098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:50:10.372033 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:10.474646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:50:10.476342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7496d-017c-4047-bebc-8d67341b45d3 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:50:10.494260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 579/1170] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:50:19.882571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=82 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:50:20.492126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=50 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:29.359525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:29.360130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:29.360130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:29.442343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:51:29.444762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:29.562730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 592/1171] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:51:29.571190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:29.571710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:29.571817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:29.649037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:51:29.650161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:29.747160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 580/1172] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:51:29.751773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:29.753592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:29.764884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e251cd-5568-4e69-b342-0ec2d783e71a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:29.826716 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:29.860157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:29.860761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:29.861040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:29.861308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:29.862473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:51:29.862868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:29.863897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:51:29.863897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:51:29.863897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:51:29.864799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:29.876570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 593/1173] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:51:29.886800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:29.896035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0bd40-d2a6-43af-ae96-3af72e671423 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:29.957768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:29.991241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:29.991864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:29.992142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:29.992411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:29.993032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:29.994045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:51:29.994045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:51:29.994045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:51:29.995251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:30.049231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 581/1174] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:51:30.053910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:30.055500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:30.088535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8793b-5ead-4d73-abe7-afc2c45b961a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:30.181725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:30.182325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.182601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.182866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.183527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:30.184525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:51:30.184525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:51:30.184525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:51:30.185732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:30.232477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 594/1175] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:51:30 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:51:30.233667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:30.235226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:30.295466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf2d7-bbd4-420a-afce-7d16ab122cbe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:30.376971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:30.387530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:30.388133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.388406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.388671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.389306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:30.390911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:30.402959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 582/1176] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:51:30.406965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:30.408541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:30.421149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec825dff-f907-42e5-a074-a3d13fa1f060 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:30.446330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:30.516467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:30.517033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.517305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.517572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.518733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:30.520340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3022-09ea-417d-b2d1-ce01bec3e0b6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:30.532454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 595/1177] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:51:30.537238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:30.538760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:30.571506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab8db-6c22-4e96-8125-58bf202bea8c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:30.664918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:30.665569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.665842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.666109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] PATH_INFO: `/v3/projects/6bcf31e2e655484db81ae730b226d706/users/b53f350adac54ebe8e92d4c4bc5fd7ce/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.689357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcf31e2e655484db81ae730b226d706, user_id=b53f350adac54ebe8e92d4c4bc5fd7ce, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:30.692113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0747fb-4e3a-46fa-946f-512e55a9b978 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:30.716829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 583/1178] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:51:30 2022] PUT /identity/v3/projects/6bcf31e2e655484db81ae730b226d706/users/b53f350adac54ebe8e92d4c4bc5fd7ce/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:51:30.728405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1817d-43e1-435f-add1-c452da016798 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.728702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1817d-43e1-435f-add1-c452da016798 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.728979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1817d-43e1-435f-add1-c452da016798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.786977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6cd1817d-43e1-435f-add1-c452da016798 None None] MFA Rules not processed for user `b53f350adac54ebe8e92d4c4bc5fd7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:51:30.788187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6cd1817d-43e1-435f-add1-c452da016798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:30.862796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 596/1179] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:51:30.875884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.876174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.876445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.878270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 584/1180] 10.222.0.26 () {54 vars in 963 bytes} [Fri Oct 14 17:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:51:30.883265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cef5a-bd43-4f29-bcc0-4633ba142981 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:30.883579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cef5a-bd43-4f29-bcc0-4633ba142981 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:30.883882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cef5a-bd43-4f29-bcc0-4633ba142981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:30.915462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:30.960128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-558cef5a-bd43-4f29-bcc0-4633ba142981 None None] MFA Rules not processed for user `fdb70aefb254402ea472c80b81124cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:51:30.961309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-558cef5a-bd43-4f29-bcc0-4633ba142981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.034854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 597/1181] 10.222.0.26 () {58 vars in 1060 bytes} [Fri Oct 14 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:51:31.042596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:31.044124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.093508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:31.147081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ed958-70d8-4e71-884f-3451983aadce None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:31.220495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:31.221095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:31.221945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:31.222219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:31.223863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.319694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:31.321062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:31.324526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:31.340076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 585/1182] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:51:31.384890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8370d-e45e-417c-bab5-f70d39af9c5a None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:31.385175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8370d-e45e-417c-bab5-f70d39af9c5a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:31.385448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8370d-e45e-417c-bab5-f70d39af9c5a None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:31.386712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 598/1183] 10.222.0.26 () {52 vars in 830 bytes} [Fri Oct 14 17:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:51:31.390390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:31.391644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.490848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93cc0-662f-4ce3-a25e-84056dbe67b4 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:31.584429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:31.585068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:31.585239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:31.585504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] PATH_INFO: `/v3/users/b53f350adac54ebe8e92d4c4bc5fd7ce` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:31.598442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53f350adac54ebe8e92d4c4bc5fd7ce)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:31.599486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:51:31.599486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:51:31.599486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:51:31.600688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:31.610304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:31.665857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53f350adac54ebe8e92d4c4bc5fd7ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:31.666386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53f350adac54ebe8e92d4c4bc5fd7ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:31.679755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53f350adac54ebe8e92d4c4bc5fd7ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:31.680192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53f350adac54ebe8e92d4c4bc5fd7ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:31.690931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53f350adac54ebe8e92d4c4bc5fd7ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:31.720166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 586/1184] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:51:31 2022] DELETE /identity/v3/users/b53f350adac54ebe8e92d4c4bc5fd7ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:51:31.724605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:31.725053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:31.725196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:31.782199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:51:31.783447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.857832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:31.870938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 599/1185] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:51:31.881350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:31.882585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:31.981575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e82ed8-f4d7-4695-8c8e-c4c2ff633449 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:32.035452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:32.056185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:32.056818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:32.057089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:32.057352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:32.058985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:32.169722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:32.171086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee894c-44ad-4e2d-98c8-8dc96ed27d87 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:32.189125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 587/1186] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:51:32.539536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:51:32.540787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:51:32.553011 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826d5c8-8403-4a42-b04e-9427acd8196b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:51:32.650987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:51:32.651649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:51:32.651920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:51:32.652180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] PATH_INFO: `/v3/projects/6bcf31e2e655484db81ae730b226d706` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:51:32.663140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcf31e2e655484db81ae730b226d706)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:51:32.664175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:51:32.664175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:51:32.664175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:51:32.665371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:51:32.723131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcf31e2e655484db81ae730b226d706', 'request_id': 'req-9a81d94d-616a-4503-b741-1632ea6521aa'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:32.731902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcf31e2e655484db81ae730b226d706', 'request_id': 'req-9a81d94d-616a-4503-b741-1632ea6521aa'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:32.745410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcf31e2e655484db81ae730b226d706', 'request_id': 'req-9a81d94d-616a-4503-b741-1632ea6521aa'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:32.767411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] The token cache is being invalidate because project 6bcf31e2e655484db81ae730b226d706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:51:32.767695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:32.768847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9a81d94d-616a-4503-b741-1632ea6521aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:51:32.770137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 600/1187] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:51:32 2022] DELETE /identity/v3/projects/6bcf31e2e655484db81ae730b226d706 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:51:42.186834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=62 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:51:42.765446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:07.319648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:07.320286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:07.320286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:07.321566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 588/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:07.326456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aeba-e8cc-4426-b3a6-af5b1d9ea099 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:07.326865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aeba-e8cc-4426-b3a6-af5b1d9ea099 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:07.327007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7aeba-e8cc-4426-b3a6-af5b1d9ea099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:07.407859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e4f7aeba-e8cc-4426-b3a6-af5b1d9ea099 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:07.409054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4f7aeba-e8cc-4426-b3a6-af5b1d9ea099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:07.511459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 601/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:07.666465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:07.668567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:07.788595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231380d-2cfc-452c-95b1-e6eb3fcbef51 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:07.793973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:07.794568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:07.794839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:07.795104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:07.803161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:07.804775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae4ac5-5abe-4ce2-aa0e-588c58caf05d service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:07.813897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 589/1190] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:08.893023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8de99-0f46-4fd2-90f5-60d6267582c2 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:08.893492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8de99-0f46-4fd2-90f5-60d6267582c2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:08.893592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8de99-0f46-4fd2-90f5-60d6267582c2 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:08.894990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 602/1191] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:08.901802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a2b9-d35a-4b78-ae54-9788497b0f31 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:08.902277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a2b9-d35a-4b78-ae54-9788497b0f31 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:08.902390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a2b9-d35a-4b78-ae54-9788497b0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:08.924481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5ca3a2b9-d35a-4b78-ae54-9788497b0f31 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:08.925763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5ca3a2b9-d35a-4b78-ae54-9788497b0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:08.934714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 590/1192] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:09.084754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8de99-0f46-4fd2-90f5-60d6267582c2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:09.098932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8de99-0f46-4fd2-90f5-60d6267582c2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:09.104899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:09.105486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:09.105761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:09.106026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:09.113859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:09.116139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069716a4-0e48-4aa5-ae7e-10c41bf2d95a service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:09.125135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 603/1193] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:09.302170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632949-6373-472a-b81b-e813135d6e8b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:09.303373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632949-6373-472a-b81b-e813135d6e8b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:09.303660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88632949-6373-472a-b81b-e813135d6e8b None None] PATH_INFO: `/v3` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:09.304951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 591/1194] 10.222.0.23 () {54 vars in 925 bytes} [Fri Oct 14 17:53:09 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:53:09.330720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecdf9-d844-4af8-b8ff-fb75dee1f51c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:09.331008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecdf9-d844-4af8-b8ff-fb75dee1f51c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:09.331304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecdf9-d844-4af8-b8ff-fb75dee1f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:09.391873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-33aecdf9-d844-4af8-b8ff-fb75dee1f51c None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:09.393024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-33aecdf9-d844-4af8-b8ff-fb75dee1f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:09.409662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:09.465001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 604/1195] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 14 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:13.159001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98444-0277-4320-b55d-2bb7b852c531 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:13.159545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98444-0277-4320-b55d-2bb7b852c531 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:13.159648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb98444-0277-4320-b55d-2bb7b852c531 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:13.160891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 592/1196] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 17:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:13.165979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8387-30ae-488a-85cf-7bc96e411653 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:13.166424 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8387-30ae-488a-85cf-7bc96e411653 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:13.166533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f8387-30ae-488a-85cf-7bc96e411653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:13.186120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-161f8387-30ae-488a-85cf-7bc96e411653 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:13.187318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-161f8387-30ae-488a-85cf-7bc96e411653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:13.196388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 605/1197] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 17:53:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:13.203851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98444-0277-4320-b55d-2bb7b852c531 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:13.217309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb98444-0277-4320-b55d-2bb7b852c531 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:13.222259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:13.222842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:13.223114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:13.223404 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:13.231780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:13.233340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d298e-eeaf-4ba5-8164-dcf7a06fdf18 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:13.243626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 593/1198] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:20.605103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670472-59c9-4537-ae69-5082ef5251ea None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:20.605690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670472-59c9-4537-ae69-5082ef5251ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:20.605690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6670472-59c9-4537-ae69-5082ef5251ea None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:20.606992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 606/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:20.613314 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174fc6-56b5-4507-9bc5-0bd415bbca62 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:20.613717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174fc6-56b5-4507-9bc5-0bd415bbca62 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:20.613866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174fc6-56b5-4507-9bc5-0bd415bbca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:20.633036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-28174fc6-56b5-4507-9bc5-0bd415bbca62 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:20.634319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-28174fc6-56b5-4507-9bc5-0bd415bbca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:20.642107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 594/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:20.799678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670472-59c9-4537-ae69-5082ef5251ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:20.814288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6670472-59c9-4537-ae69-5082ef5251ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:20.819728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:20.820317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:20.820595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:20.820864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:20.828755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:20.830326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff7a1-66c5-48e5-a688-1c4df5f0bacf service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:20.841213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 607/1201] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:21.910904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c901bf-1e07-445d-8fac-428a1241f7b0 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:21.912112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c901bf-1e07-445d-8fac-428a1241f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:21.912112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c901bf-1e07-445d-8fac-428a1241f7b0 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:21.913357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 595/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 17:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:21.919955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4b5-4b95-4b34-8af2-5523e305e538 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:21.920350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4b5-4b95-4b34-8af2-5523e305e538 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:21.920528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5db4b5-4b95-4b34-8af2-5523e305e538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:21.943191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8e5db4b5-4b95-4b34-8af2-5523e305e538 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:21.944338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8e5db4b5-4b95-4b34-8af2-5523e305e538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:21.952180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 608/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:22.107330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c901bf-1e07-445d-8fac-428a1241f7b0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:22.121302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c901bf-1e07-445d-8fac-428a1241f7b0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:22.126626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:22.127205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:22.127502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:22.127767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:22.135771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:22.137334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5671b1a-ca98-4b17-8472-3467c901222e service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:22.146864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 596/1204] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:26.278922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:26.279487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:26.279594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:26.280857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 609/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:26.286083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193f59-4eae-4efa-803b-4c3694bda2a8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:26.286687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193f59-4eae-4efa-803b-4c3694bda2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:26.286687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193f59-4eae-4efa-803b-4c3694bda2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:26.305568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-97193f59-4eae-4efa-803b-4c3694bda2a8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:26.306743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-97193f59-4eae-4efa-803b-4c3694bda2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:26.314396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 597/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:53:26.600848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:26.602546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:26.679735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305102d1-e58c-4e60-9bf0-3c394ba1fd14 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:26.683322 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:26.683934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:26.684214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:26.684483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:26.693889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:26.695323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ea931-5bc6-4fe2-b6bb-ec5611e0dbb3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:26.704631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 610/1207] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:28.859831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0b75-9905-4a0e-994e-4f7ff13ee60e None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:28.860387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0b75-9905-4a0e-994e-4f7ff13ee60e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:28.860387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c0b75-9905-4a0e-994e-4f7ff13ee60e None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:28.861722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 598/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:28.867783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ed134-b52a-4eca-b0df-4ee9272cd5cb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:28.868229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ed134-b52a-4eca-b0df-4ee9272cd5cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:28.868374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ed134-b52a-4eca-b0df-4ee9272cd5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:28.890425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f21ed134-b52a-4eca-b0df-4ee9272cd5cb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:28.891659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f21ed134-b52a-4eca-b0df-4ee9272cd5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:28.901309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 611/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:29.188668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c0b75-9905-4a0e-994e-4f7ff13ee60e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:29.199250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c0b75-9905-4a0e-994e-4f7ff13ee60e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:29.202783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:29.203394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:29.203670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:29.203935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:29.212999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:29.214414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e4aac-959d-4ea7-b3da-c9fe07245a47 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:29.224018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 599/1210] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:33.043904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:33.044453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:33.044453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:33.045775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 612/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:33.050978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195cc2-2eef-4896-b3d0-6debc434228b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:33.052414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195cc2-2eef-4896-b3d0-6debc434228b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:33.052414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81195cc2-2eef-4896-b3d0-6debc434228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:33.059690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=81 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:33.072206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-81195cc2-2eef-4896-b3d0-6debc434228b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:33.073380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-81195cc2-2eef-4896-b3d0-6debc434228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:33.081019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 600/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:53:33.385263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:33.386937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:33.450863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:33.464639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ed55-a404-45a2-ac66-4e3daf3476cb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:33.468163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:33.468764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:33.469041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:33.469311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:33.478169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:33.479611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851dff-57a2-4ad3-aeb5-07e9574cdde8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:33.489354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 613/1213] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:35.621510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:35.622078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:35.622173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:35.623525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 601/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 17:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:53:35.628615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5904-a4f6-4929-a3bd-cf189b4284f7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:35.629017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5904-a4f6-4929-a3bd-cf189b4284f7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:35.629723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb5904-a4f6-4929-a3bd-cf189b4284f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:35.648796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8acb5904-a4f6-4929-a3bd-cf189b4284f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:53:35.649983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8acb5904-a4f6-4929-a3bd-cf189b4284f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:35.657709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 614/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 17:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:53:35.958697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:53:35.960520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:53:35.973433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e84706-c046-43dc-9a0c-b9fefe58c05d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:53:35.976988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:53:35.977577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:53:35.977856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:53:35.978128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:53:35.987076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:53:35.988582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69ac7a-0d3a-4f71-b451-a8c9d81e4239 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:53:35.997874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 602/1216] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:53:45.644102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=11 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:53:45.993829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=8 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:06.360965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57522-48cb-4a73-b3fd-305f91ea6f76 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.363062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57522-48cb-4a73-b3fd-305f91ea6f76 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.363062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57522-48cb-4a73-b3fd-305f91ea6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.363602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef34e7-415f-408d-b567-4ec7cb4995ca None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.364052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef34e7-415f-408d-b567-4ec7cb4995ca None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.364141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef34e7-415f-408d-b567-4ec7cb4995ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.388173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-edc57522-48cb-4a73-b3fd-305f91ea6f76 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.389405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-edc57522-48cb-4a73-b3fd-305f91ea6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.399850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 615/1217] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.418000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.418000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.418000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.421745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-40ef34e7-415f-408d-b567-4ec7cb4995ca None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.423317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-40ef34e7-415f-408d-b567-4ec7cb4995ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.441242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 603/1218] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:06.446771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.448024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.461928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 616/1219] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:06.466053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.466644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.466851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.467358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.481814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58757-9681-401f-8242-21bebd2e2616 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.491746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.492210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.492400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.492655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.493315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:06.493618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.495247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ba86-ded9-481a-b7cd-76cc32b8dfbf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.508363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.509931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.517309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 617/1220] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:55:06.519031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.519418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.519691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.529394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 604/1221] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.530557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.547662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ec0b9-6c50-457d-b90d-4fa38ea6d604 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.558193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.558498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.559375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.559500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.559998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.560487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.562750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.565086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423044b1-6a0d-496a-8fc9-0d0791b0b29e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.571982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 618/1222] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.572886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.587846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5da199-f728-491d-b3d2-88fc9c0f09ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.601041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.601792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.602067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.602333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.602983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:06.603296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.604896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc7da2-08b8-4614-9089-443066f2d9b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.629782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 619/1223] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:06.629782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.629782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.629782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.637150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 605/1224] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:06.639654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.640220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.640725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.656726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.658020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.671423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.672952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.749594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 620/1225] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.749829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 606/1226] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:06.749915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.750023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.761519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdafee2-d530-4757-99b5-49e3639f42b2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.765511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab127e-08a0-43c6-8306-58d27c9354b8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.766241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.766847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.767124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.767423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.768165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.770158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ce0d-f77b-4bcf-a06e-746bccfecbd7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.770279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.770814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.771079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.771375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.772018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.773874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc3835-9b01-466c-a853-80faa8e88378 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.800350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 621/1227] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:06.800350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891db2-4ebc-42d7-9c89-f8553ab741f1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.800677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 607/1228] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:06.800784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891db2-4ebc-42d7-9c89-f8553ab741f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.800784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891db2-4ebc-42d7-9c89-f8553ab741f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.800962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.800962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.800962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.818564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eb891db2-4ebc-42d7-9c89-f8553ab741f1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.819797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb891db2-4ebc-42d7-9c89-f8553ab741f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.820185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.821327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.880127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 622/1229] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.881285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b59c-a37c-4e6c-ad33-435971e94f47 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.881570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b59c-a37c-4e6c-ad33-435971e94f47 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.881840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b59c-a37c-4e6c-ad33-435971e94f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.882536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 608/1230] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.883242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.893511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e53a-505f-40c0-9095-8e2223ad5fcc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.898381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.898993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.899293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.899578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.900228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:06.900531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.901581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:55:06.901581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:55:06.901581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:55:06.902471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19b7a-f9a6-4567-8dbe-20e9d265bfe0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.909098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6834b59c-a37c-4e6c-ad33-435971e94f47 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.910428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6834b59c-a37c-4e6c-ad33-435971e94f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.914781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 609/1231] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:06.916030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.916317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.916589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.919079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 623/1232] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.920255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.920638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.920967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.941425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.942629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.945972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:06.947121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:06.950560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 624/1233] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.951560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.956942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 610/1234] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:06.957778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:06.964500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adebf3-3e20-4910-8c05-04f3673542a3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.966983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cc61a-4821-49c7-aa16-947824b54254 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:06.969122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.969721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.969992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.970319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.970962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.972580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:06.973162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.973425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214af3c5-7a68-4eeb-be85-5cce68a54ed0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.973540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.973690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.974308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:06.975325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:55:06.975325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:55:06.975325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:55:06.976659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928011-2edc-48e0-a2fa-44c86e8e9512 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:06.986316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 625/1235] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:06.986316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:06.986316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:06.986316 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:06.993267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.000988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 611/1236] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.002292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb20e7-f44b-4cbb-8ef4-021dc626013d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.002568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb20e7-f44b-4cbb-8ef4-021dc626013d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.002843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb20e7-f44b-4cbb-8ef4-021dc626013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.008401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:07.009586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:07.017292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 626/1237] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:07.018812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.023804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-51cb20e7-f44b-4cbb-8ef4-021dc626013d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:07.024983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-51cb20e7-f44b-4cbb-8ef4-021dc626013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:07.028644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735daf-6784-49cd-920f-b6e40a430668 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.033118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.033262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 612/1238] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:07.034521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.034862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.034974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace043-b0db-4ce0-b7f0-17498c739507 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.035139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.035243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace043-b0db-4ce0-b7f0-17498c739507 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.035477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace043-b0db-4ce0-b7f0-17498c739507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.035805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.036843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:55:07.036843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:55:07.036843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:55:07.038032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.042546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.055387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1bace043-b0db-4ce0-b7f0-17498c739507 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:07.056582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1bace043-b0db-4ce0-b7f0-17498c739507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:07.065011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 613/1239] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:07.066302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719192-ae35-4566-885d-68b867f2f555 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.066587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719192-ae35-4566-885d-68b867f2f555 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.066855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719192-ae35-4566-885d-68b867f2f555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.073891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 627/1240] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.073891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.087375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-11719192-ae35-4566-885d-68b867f2f555 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:07.088568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-11719192-ae35-4566-885d-68b867f2f555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:07.133798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3599-60ac-448e-9b90-d66d3c89eb88 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.138343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.138931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.139214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.139511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.140157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:07.140455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.142038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.148633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 614/1241] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:07.149470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719192-ae35-4566-885d-68b867f2f555 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.158625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 628/1242] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:07.158625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.163303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719192-ae35-4566-885d-68b867f2f555 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.167412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4aa47-db06-4952-8f2d-153dac293dd1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.167987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.168589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.168869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.169138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.169771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.171405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.172240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.172933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.173334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.173681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.174923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.176536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.182644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 615/1243] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.183389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.192091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 629/1244] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.192091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.193921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d7f25-824a-4d08-af6a-e29652ab5ba9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.198486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.199067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.199377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.199598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af3e7c-ee16-4cac-b431-fafb6968bf0d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.199726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.200269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:07.200569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.202145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.204158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.204729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.205004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.205273 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.206059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:07.206729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.208308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.214946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 616/1245] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:07.220103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.227611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 630/1246] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:07.227611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.230538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064374e9-36a7-4864-a1fe-7a8a88869f40 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.231571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4c96-48eb-4273-b9c1-13158834bf88 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.235796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.236112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.236379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.237236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.237513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.237621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.237840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.237952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.238498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:07.238607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.238798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.240396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.240514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.253104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 617/1247] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:07.254020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.263085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 631/1248] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.263909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.268549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ef93-cb7d-4fb5-a25c-912dc050c67d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.273369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.274074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.274352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.274469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabbc2a-88ab-4d13-bec1-0e964597a7eb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.274646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.275333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:07.275650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.277230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.279595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.280175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.280449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.280715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.281386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.283271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.289932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 618/1249] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:07.290705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.301699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef1498-3047-493a-829c-a66084d5fd52 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.306742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.307417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.307739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.307967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] PATH_INFO: `/v3/projects/fa98a9499c844aa0b9c87a7b6afc2443/users/6a5d2cb64aa841d0b3303581aaf3d36b/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.315118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 632/1250] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.316105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.324703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa98a9499c844aa0b9c87a7b6afc2443, user_id=6a5d2cb64aa841d0b3303581aaf3d36b, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.327417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.342972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 619/1251] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:07 2022] PUT /identity/v3/projects/fa98a9499c844aa0b9c87a7b6afc2443/users/6a5d2cb64aa841d0b3303581aaf3d36b/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:07.343870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.384770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086ce57-7f98-46c6-9b59-50daf556a032 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.403358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.407937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48b03f-c6ff-4093-85a0-413fbf64d3b6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.413848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.414454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.414910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.415184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.415842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.418223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.434213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.444743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.445347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.445618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.445888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.446518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.448145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.448430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 620/1252] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.449210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.461787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 633/1253] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.462568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.475703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e5a7-ef9e-4783-87a0-1b79c4112a16 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.513822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f14329-59e5-4d79-b87f-a8ecab58c85b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.518812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.519433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.519710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.519974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.520596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.522481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.532629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.533260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.534060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.534481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.535156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.537090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.549207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 621/1254] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.550456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.568545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 634/1255] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.568545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.617231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a2f80-5b0d-433c-8363-f7b6721776a6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.630135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfc62-ff43-4185-a6cd-fce739700562 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.634758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.635440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.635664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.635933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.636558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.638636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.665419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 635/1256] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.666218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.676020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.676634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.676910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.677178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.677849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.679501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0b6d-67e2-48a2-b3af-fa53ae79e5c9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.698736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 622/1257] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.698736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.698736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.698736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.703594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.717577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:07.718854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:07.736215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb3c6-acd2-4e61-83bc-9215d6d85d08 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.738200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:07.741671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.742273 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.742551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.742823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.743483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.745398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.768030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 636/1258] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.768817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.778344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9329-e554-450d-9153-7df1e1d9cd21 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.780669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 623/1259] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:07.781462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.783111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.783838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.784188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.784455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.785287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.787135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.790849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae112ce-8307-4e72-aad6-9dc90938cd64 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.795818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.796473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.796752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.797023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] PATH_INFO: `/v3/projects/89613423e69348da91ea084809b1f162/users/041b4ce1cbee449aa9c66862435f8a9a/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.813910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 637/1260] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.813910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.816299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89613423e69348da91ea084809b1f162, user_id=041b4ce1cbee449aa9c66862435f8a9a, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.818976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.824314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87890a-a58f-4c37-87f2-c96bc10bb6dd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.829098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.829679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.829952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.830217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.831041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.832327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 624/1261] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:07 2022] PUT /identity/v3/projects/89613423e69348da91ea084809b1f162/users/041b4ce1cbee449aa9c66862435f8a9a/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:07.833207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.833586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.854057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 638/1262] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.855087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.865295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50010c0-99b4-41f2-94e7-ca18d378983e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.903602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e46dd-5fb2-4548-b01a-8f2ba33de1cc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.908613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.909225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.909504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.909776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.910432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.912412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.921628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.922234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.922505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.922777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.923427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.926546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.937794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 625/1263] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.937794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.946684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf45da-c054-41fe-9f23-117c854e25aa admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.951816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 639/1264] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:07 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:07.951816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.954496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.955082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.955929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.956593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.957318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.958809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.962462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f394-3e54-4f48-81c3-1579c2fcc03b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.967122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.967740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.968019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.968288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.968973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 626/1265] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.969089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:07.970720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:07.972773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.981520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 640/1266] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:07.982318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:07.992568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9347f-f444-452b-9008-45885946bf37 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:07.997131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:07.997707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:07.997985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:07.998253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:07.998878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.000627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bc222-3fb5-4c5b-862f-3fe424b59aaf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.012107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 641/1267] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.013356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.013644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.013920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.027733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc74358-2035-4c18-afaa-972aa0332e92 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.031357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.031954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.032226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.032486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.041585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.041758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] MFA Rules not processed for user `041b4ce1cbee449aa9c66862435f8a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:08.042917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:08.043036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.053562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 627/1268] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:08.054180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.068522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54402bf-abd8-4b3c-aa3c-3c8987c5d083 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.073736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.074339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.074619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.074892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.075735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.078139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.089014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:08.092656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 628/1269] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.092656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.103626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977f51-646e-4680-b6bf-f3f8eb585a7b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.108457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.109056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.109337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.109610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.110252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.113356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.119408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:08.123339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 642/1270] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:08.126450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 629/1271] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.127856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.128795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.140552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c42ac-6297-46f1-9912-b2aa7cc9117a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.143518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda33d-d6b3-48b7-8c84-5ed317fe3034 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.145266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.145880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.146154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.146423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.147156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.148735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.148867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.149811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.149811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.150241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] PATH_INFO: `/v3/projects/f93525eca27e4da9a6f73556c1914e52/users/45850cb145004c0e996799927e2f5a52/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.161193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 643/1272] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.162515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.169633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93525eca27e4da9a6f73556c1914e52, user_id=45850cb145004c0e996799927e2f5a52, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.172850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.174849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e913ed-2ee9-4465-9b68-be6584c979c0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.181248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.181874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.182153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.182346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.183096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.184608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.192499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 630/1273] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/f93525eca27e4da9a6f73556c1914e52/users/45850cb145004c0e996799927e2f5a52/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.192499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.198582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 644/1274] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.199628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.210341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f805f-7935-4f0e-81dd-028a2ac381fd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.273175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341202f-52fe-4f82-aa6c-aff817281441 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.278360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.278987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.279265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.279403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.279848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.280062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.280300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.280510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.280630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.281207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.282140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.282849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.293791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 645/1275] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.294552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.298820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 631/1276] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.298820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.305419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1272f-8f5e-490c-99ed-be1a44bb5707 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.310051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.310804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.310931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.311183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.311873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.313471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.325354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 646/1277] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.325354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.347992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2afb33-e003-4407-922a-ee6e9cf7a9b0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.356281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.356899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.359601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.359601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.359601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.361137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790d39-7127-4e5d-a20b-cfe84ee7147d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.373685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298981c-f779-4789-aab4-95236c45128e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.374429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 647/1278] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:08.375879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.376164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.376443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.379679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.380985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.381361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.381830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.398916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:08.400263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:08.412301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 648/1279] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:08.412301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.423649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fe359-f777-4fa9-9930-0b99835e72e3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.431303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.432264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.432782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.433307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] PATH_INFO: `/v3/projects/4c20b6a9ec5042878702085c1e42dbdd/users/57705b9fa1544050b59d5bf298d66931/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.450139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20b6a9ec5042878702085c1e42dbdd, user_id=57705b9fa1544050b59d5bf298d66931, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.452806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.452944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.454317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.465869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 632/1280] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:08.466667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.468777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 649/1281] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/4c20b6a9ec5042878702085c1e42dbdd/users/57705b9fa1544050b59d5bf298d66931/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.469761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.484328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373135cd-5d31-43a2-aabe-4c2bb76507b7 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.515774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:08.558991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9a4f-5815-41a5-aa25-c938fed78995 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.563722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.563898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.564063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.564341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] PATH_INFO: `/v3/projects/c6b8021789d24b2594ed7008ad484506/users/a961d3cd2f484100a041f733e02c319f/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.568155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.570141 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.570600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.571072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] PATH_INFO: `/v3/projects/11f298e50a654f40b16b056582daf3fa/users/4ac0b10bd13843169665e23ea4ad7c74/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.576363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:08.586281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b8021789d24b2594ed7008ad484506, user_id=a961d3cd2f484100a041f733e02c319f, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.589980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.608462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 633/1282] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/c6b8021789d24b2594ed7008ad484506/users/a961d3cd2f484100a041f733e02c319f/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.608606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f298e50a654f40b16b056582daf3fa, user_id=4ac0b10bd13843169665e23ea4ad7c74, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.609912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.620041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.645113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 650/1283] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/11f298e50a654f40b16b056582daf3fa/users/4ac0b10bd13843169665e23ea4ad7c74/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.646229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.712152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939312e-8fb3-45f0-9e07-f5f7718e4474 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.763029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52ef46-86ba-4914-9a1b-11121593ddd0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.769721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.770441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.770744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.771525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] PATH_INFO: `/v3/projects/728a674f0a9f4b66837fe5662b210a20/users/2603a08b473e465280a4c3fe8eaec557/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.788642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728a674f0a9f4b66837fe5662b210a20, user_id=2603a08b473e465280a4c3fe8eaec557, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.792484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.793143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:08.793896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.794459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.794844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] PATH_INFO: `/v3/projects/c971b9fa064e42168b9a976f4fea642d/users/5cd61d7e706d46c6992c7abbbfc4b094/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.810047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 651/1284] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/728a674f0a9f4b66837fe5662b210a20/users/2603a08b473e465280a4c3fe8eaec557/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.815645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c971b9fa064e42168b9a976f4fea642d, user_id=5cd61d7e706d46c6992c7abbbfc4b094, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:08.818561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de52b5-0491-4913-b6ed-45e8c86682dd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:08.821560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:08.824838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:08.837410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 634/1285] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:08 2022] PUT /identity/v3/projects/c971b9fa064e42168b9a976f4fea642d/users/5cd61d7e706d46c6992c7abbbfc4b094/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:08.837410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24196961-7fc5-4084-8745-113339060cb8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.837410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24196961-7fc5-4084-8745-113339060cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.837410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24196961-7fc5-4084-8745-113339060cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.860241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-24196961-7fc5-4084-8745-113339060cb8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:08.861735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-24196961-7fc5-4084-8745-113339060cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:08.902923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:08.920506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f0b5-ca96-4232-8faf-48143f05b8e2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:08.937391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 635/1286] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:08.939317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6726-fc4c-4512-b43d-7ce40250adbe None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.940357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6726-fc4c-4512-b43d-7ce40250adbe None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.940732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d6726-fc4c-4512-b43d-7ce40250adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:08.977244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-350d6726-fc4c-4512-b43d-7ce40250adbe None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:08.978782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-350d6726-fc4c-4512-b43d-7ce40250adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:08.992300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 636/1287] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:08.993982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ad0e-e319-4534-ac46-c52b8e07b723 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:08.994623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ad0e-e319-4534-ac46-c52b8e07b723 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:08.995172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2ad0e-e319-4534-ac46-c52b8e07b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.037386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f8a2ad0e-e319-4534-ac46-c52b8e07b723 None None] MFA Rules not processed for user `4ac0b10bd13843169665e23ea4ad7c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:09.038132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.039958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.040138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f8a2ad0e-e319-4534-ac46-c52b8e07b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:09.040242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.040851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.052810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.055347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6c121-6e40-4206-9c61-28280a0c04f1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.070003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 652/1288] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:09.071460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.071740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.072005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.113426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] MFA Rules not processed for user `2603a08b473e465280a4c3fe8eaec557`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:09.115010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:09.137583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:09.175747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 637/1289] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:09.178334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.178613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.183392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.230339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 653/1290] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:09.233662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.239157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:09.240582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:09.249494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 638/1291] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:09.250747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.263030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b382f7-9213-454b-afd0-fae96305b083 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.264249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579909c-5c8b-4c8d-a4eb-8fb315c4a62b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.267365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.269190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.269518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.269783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.276107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.276932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.277215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.277534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.281172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.282735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.294329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.295834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.296105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 639/1292] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:09.297509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.307753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 654/1293] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:09.308588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.311457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e599e-87dc-4d9a-a26f-e9699acbada9 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.319424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.320222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.320763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.320876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.321671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.321802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823fe65-cced-47d8-bf35-f2247acb359e service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.323806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.337359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.337595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.337853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.338140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.338813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.340930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.377593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 640/1294] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:09.377593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.410270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 655/1295] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:09.415999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.519537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc811225-f9ef-4bbb-b30d-989b78bf3c22 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.545685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454628-521e-4835-8204-36e9c0092f0c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.567546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.568181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.568907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.568907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.569773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.571790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.616872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 656/1296] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:09.618057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.625176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:09.633741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc847-c75d-4390-9fd6-5434ec1d23db admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.639596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.642083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.642416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.643768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.644498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.646909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.664076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.664969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.665261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.665516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.679367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.682694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.689372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 657/1297] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:09 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:09.691147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.707794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 641/1298] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:09.709146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.712490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679e48-215c-4447-b767-c004847eead2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.723432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4424-4559-4947-8984-749691e395ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.724063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4424-4559-4947-8984-749691e395ee admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.724342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4424-4559-4947-8984-749691e395ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.724613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4424-4559-4947-8984-749691e395ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.726490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4424-4559-4947-8984-749691e395ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.728015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36d146-2da4-4d11-ac2e-370643a42be1 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.729921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4424-4559-4947-8984-749691e395ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.738928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.739590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.739867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.740133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.741984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.746135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.753726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 658/1299] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:09.757602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4424-4559-4947-8984-749691e395ee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.772579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 642/1300] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:09.773893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.778794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4424-4559-4947-8984-749691e395ee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.791343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0fd8-94b8-4285-821e-893bb48a986c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.792554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.793213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.793495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.795554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.796225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.797554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.798553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.799794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.800661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] PATH_INFO: `/v3/projects/3a5c76f2513948e094870eade4105e32/users/876d525139c64f8697be74ef76a0a757/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.803972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.823051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 659/1301] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:55:09.823959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5c76f2513948e094870eade4105e32, user_id=876d525139c64f8697be74ef76a0a757, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.828340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.831523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.848014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c9e0-85d4-40fc-b71a-c430b279e94b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:09.855628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 643/1302] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:09 2022] PUT /identity/v3/projects/3a5c76f2513948e094870eade4105e32/users/876d525139c64f8697be74ef76a0a757/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:09.860647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:09.891559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:09.935605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:09.936659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:09.937056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:09.937420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] PATH_INFO: `/v3/projects/a349f2d84aa64c8aae6b788a23d86a1d/users/7d56f9b334cd413d985ec48af6ce9563/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:09.969414 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a349f2d84aa64c8aae6b788a23d86a1d, user_id=7d56f9b334cd413d985ec48af6ce9563, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:09.973585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426665-a520-4d9b-800c-16aaf058dfc4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:09.996819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 660/1303] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:09 2022] PUT /identity/v3/projects/a349f2d84aa64c8aae6b788a23d86a1d/users/7d56f9b334cd413d985ec48af6ce9563/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:10.008685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.009243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.009584 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.022064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4121-61be-4fb4-ad4c-55fa8ae9f9fd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.093155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] MFA Rules not processed for user `7d56f9b334cd413d985ec48af6ce9563`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:10.104841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:10.112030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.113510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.114305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.114305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.116519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.118419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.133567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 644/1304] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:10.140006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.154913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e9108-3748-488d-b455-7a87b22e6903 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.164612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.166068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.166559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.167485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] PATH_INFO: `/v3/projects/3a5c76f2513948e094870eade4105e32/users/876d525139c64f8697be74ef76a0a757/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.170907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5c76f2513948e094870eade4105e32, user_id=876d525139c64f8697be74ef76a0a757, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.175916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b33f-07bb-4384-95bc-b2e514b48ffb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.202948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 645/1305] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:10 2022] PUT /identity/v3/projects/3a5c76f2513948e094870eade4105e32/users/876d525139c64f8697be74ef76a0a757/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:10.205014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.207385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.207841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.262408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] MFA Rules not processed for user `876d525139c64f8697be74ef76a0a757`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:10.269406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:10.273476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 661/1306] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:10.274498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.288528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64518-1bdf-4b96-9dda-f5dd6776eb98 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.324849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:10.412551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.413275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.413637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.413946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.414928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.415932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 646/1307] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:10.423290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.431413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.467400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 662/1308] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:10 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:10.468830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.533851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:10.580423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c6149-ade9-4816-bdae-314c4bb5c2d7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.638951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410da8a-2f77-47b8-bd5a-27973de0bb9a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.651760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.652493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.652777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.654398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.655253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.662355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.699787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.700503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.700830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.701136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.710301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 663/1309] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:10 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:55:10.714248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.739998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74736b7b-02e5-4db4-b67b-2408d7d47ad5 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.751821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.752669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.752798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.753074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.753729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.755378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.780456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 664/1310] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:10.783954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.804335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de0e0-db43-469a-9ceb-5f7ee89d41db admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.804815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.807071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.821582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:10.822271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:10.822651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:10.822928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] PATH_INFO: `/v3/projects/d40b3220c34e4a719e649366068b4589/users/b9d6f733dc27469a806617d0d8410d79/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:10.823832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 647/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:10.853029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40b3220c34e4a719e649366068b4589, user_id=b9d6f733dc27469a806617d0d8410d79, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:10.856476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:10.890791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 665/1312] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:10 2022] PUT /identity/v3/projects/d40b3220c34e4a719e649366068b4589/users/b9d6f733dc27469a806617d0d8410d79/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:10.896925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:10.915619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2438ec-c449-4382-af0f-d5e4d41a5c9a service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:10.990394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:11.030108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:11.097654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:11.098261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.098664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.098948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.101196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:11.103534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c519f55-7894-4cfd-886d-b10231c13f68 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:11.129795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 648/1313] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:11.137498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4125-5289-4e28-8e5d-08c5a41e02f4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:11.138092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e7de-0845-47e0-b221-ff966c601fb5 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.138384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e7de-0845-47e0-b221-ff966c601fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.138661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e7de-0845-47e0-b221-ff966c601fb5 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.140223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 649/1314] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 17:55:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:11.140733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e7de-0845-47e0-b221-ff966c601fb5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:11.146898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:11.147661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.148054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.148388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.246470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e7de-0845-47e0-b221-ff966c601fb5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:11.246470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:11.246470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.246470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.246892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] PATH_INFO: `/v3/projects/d40b3220c34e4a719e649366068b4589/users/b9d6f733dc27469a806617d0d8410d79/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.246892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40b3220c34e4a719e649366068b4589, user_id=b9d6f733dc27469a806617d0d8410d79, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:11.246892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ad29f-d570-4a2e-a7aa-cf4293a5a869 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:11.246892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 650/1315] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:11 2022] PUT /identity/v3/projects/d40b3220c34e4a719e649366068b4589/users/b9d6f733dc27469a806617d0d8410d79/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:11.246892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee03c-612a-4d8b-a09c-7918617bc250 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.247242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee03c-612a-4d8b-a09c-7918617bc250 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.247242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee03c-612a-4d8b-a09c-7918617bc250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.345336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bb2ee03c-612a-4d8b-a09c-7918617bc250 None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:11.347465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bb2ee03c-612a-4d8b-a09c-7918617bc250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:11.351463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:11.354941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167dd52-0729-466a-8fd3-91fac2c135f5 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:11.382214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 666/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:11.386684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.394044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.395464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.481924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] MFA Rules not processed for user `b9d6f733dc27469a806617d0d8410d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:11.489868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 651/1317] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 17:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:11.490084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:11.498878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b43d1-6fff-4570-bffb-c8ce1367e51b None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.499132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b43d1-6fff-4570-bffb-c8ce1367e51b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.499434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b43d1-6fff-4570-bffb-c8ce1367e51b None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.505493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 652/1318] 10.222.0.26 () {54 vars in 912 bytes} [Fri Oct 14 17:55:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:11.506806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261037-32c3-400a-98d8-aede703cf839 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.507095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261037-32c3-400a-98d8-aede703cf839 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.507407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261037-32c3-400a-98d8-aede703cf839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.550296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-88261037-32c3-400a-98d8-aede703cf839 None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:11.551574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-88261037-32c3-400a-98d8-aede703cf839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:11.574808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:11.576430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 653/1319] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:11.609415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261037-32c3-400a-98d8-aede703cf839 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:11.726903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 667/1320] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:11.727948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261037-32c3-400a-98d8-aede703cf839 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:11.740702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:11.741331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.741610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.741882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.764453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:11.765932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:11.797331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 654/1321] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:11.854772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:11.881278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6656f-9dad-4e57-994d-3e6d3cd301a7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:11.896460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:11.898236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:11.901166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:11.901750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:11.930864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:11.935926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f9ee9-12b0-47ce-b0b2-db6e999f05b7 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:11.966520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 668/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:13.009093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:13.021888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973c5c5-427d-4142-83bd-86b60bd1a9c3 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:13.030922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:13.033839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:13.035229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:13.035719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:13.129331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:13.250200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:13.259480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:13.295313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:13.295313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:13.295313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:13.336802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 655/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:13.405258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] MFA Rules not processed for user `a961d3cd2f484100a041f733e02c319f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:13.424443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:13.641942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 669/1324] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:13 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:13.656064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:13.800667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710c6b-e53f-45a5-b147-bfd84f0c311c service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:13.808273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:13.809308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:13.815329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:13.815913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:13.816926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:13.819888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:13.878610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 656/1325] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:13 2022] POST /identity/v3/projects => generated 403 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:13.882868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:13.901618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2ed26-e5d2-43b3-b8e8-13607b22d071 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:14.106006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:14.106661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.106934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.107202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.110047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:14.122199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:14.199098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 670/1326] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:13 2022] POST /identity/v3/users => generated 308 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:14.201291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:14.232652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b59f61-54c8-472d-8e17-1a36cd818c62 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:14.253171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:14.254640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.255107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.255567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.256378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:14.258166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:14.293129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 657/1327] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:55:14.297569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:14.313703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908528ea-3dfa-47c6-a378-ffbd39b40691 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:14.347646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:14.348726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.348726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.349061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] PATH_INFO: `/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21/users/aa02bd7926734642bb77e5c8ab7af994/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.390070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20ad8dd7b754a4ca11fa79e3fa14b21, user_id=aa02bd7926734642bb77e5c8ab7af994, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:14.393649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:14.422476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 671/1328] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:14 2022] PUT /identity/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21/users/aa02bd7926734642bb77e5c8ab7af994/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:14.426343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:14.441077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6898e-df6d-46ad-bf56-ccb4da39ffd5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:14.544376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:14.545995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.546280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.546553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.547212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:14.561550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd962-d1fa-4125-94b5-ae64614fccf0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:14.577370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:14.577952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 658/1329] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:55:14.586236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:14.594304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6a056-00c2-45a2-bc56-32234cc0f4d2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:14.603712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:14.604398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.604680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.604955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] PATH_INFO: `/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21/users/aa02bd7926734642bb77e5c8ab7af994/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.610415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20ad8dd7b754a4ca11fa79e3fa14b21, user_id=aa02bd7926734642bb77e5c8ab7af994, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:14.614046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2220012-7993-4ff7-8f05-48c6c9c9e2ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:14.648188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 672/1330] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:14 2022] PUT /identity/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21/users/aa02bd7926734642bb77e5c8ab7af994/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:14.835735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51305-8452-4a6d-8e10-c5d70708afea None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.836036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51305-8452-4a6d-8e10-c5d70708afea None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.836291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51305-8452-4a6d-8e10-c5d70708afea None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.838483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 659/1331] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 17:55:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:14.850349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:14.850682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:14.850930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:14.885825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:14.887839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:15.001522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d955-2348-48e8-9f0e-2ca6f94ccfb8 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:15.002431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d955-2348-48e8-9f0e-2ca6f94ccfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:15.002629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d955-2348-48e8-9f0e-2ca6f94ccfb8 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:15.004308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 660/1332] 10.222.0.26 () {54 vars in 912 bytes} [Fri Oct 14 17:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 17:55:15.010212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:15.010495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:15.010774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:15.014798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 673/1333] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 17:55:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:15.045634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:15.048264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:15.077485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 661/1334] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:55:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:15.085470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:15.224723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af83796-8bc0-41ed-8f3a-6f5af6b1d286 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:15.235029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:15.237638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:15.238098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:15.238540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:15.256659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:15.261383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12c1b-df3b-4344-8093-deeb94f7d9b8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:15.293075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 674/1335] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:15.873583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:15.958081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:16.043419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f783b2-bd42-44bf-8241-2dfb1e9fba9c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:16.050802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:16.051962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:16.052454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:16.052962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] PATH_INFO: `/v3/users/2603a08b473e465280a4c3fe8eaec557` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:16.054580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2603a08b473e465280a4c3fe8eaec557)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:16.057513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:16.136592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2603a08b473e465280a4c3fe8eaec557'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:16.137621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2603a08b473e465280a4c3fe8eaec557'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:16.147439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2603a08b473e465280a4c3fe8eaec557'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:16.148664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2603a08b473e465280a4c3fe8eaec557'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:16.169622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2603a08b473e465280a4c3fe8eaec557'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:16.237255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 662/1336] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:15 2022] DELETE /identity/v3/users/2603a08b473e465280a4c3fe8eaec557 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:16.240540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2df57-641b-4dc2-96cd-f053f437bec8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:16.241114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2df57-641b-4dc2-96cd-f053f437bec8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:16.241114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2df57-641b-4dc2-96cd-f053f437bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:16.272878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-44f2df57-641b-4dc2-96cd-f053f437bec8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:16.274613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-44f2df57-641b-4dc2-96cd-f053f437bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:16.368491 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 675/1337] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:16.397961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:16.403049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:16.544475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c2b96-654e-434d-923e-341f0223da72 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:16.552297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:16.553665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:16.562703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:16.563300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:16.587589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:16.590116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:16.615228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 663/1338] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:16.863623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340cf3a-dafb-401f-bc82-d9abefd8d20a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:16.865455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340cf3a-dafb-401f-bc82-d9abefd8d20a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:16.865894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340cf3a-dafb-401f-bc82-d9abefd8d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:16.951812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e340cf3a-dafb-401f-bc82-d9abefd8d20a None None] MFA Rules not processed for user `aa02bd7926734642bb77e5c8ab7af994`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:16.963665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e340cf3a-dafb-401f-bc82-d9abefd8d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:17.008119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:17.198814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 676/1339] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:18.603057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:18.604723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:18.822411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:18.833990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464a08e-3ab9-4c67-be29-c57842d25ac7 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:18.841653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:18.844064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:18.844666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:18.845102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:18.847499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:19.016580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:19.020122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6df52d-f9b0-4aa5-a265-e41cfa52e329 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:19.052046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 664/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:19.775537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:19.776431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:19.777355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:19.779081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 677/1341] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:55:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:19.818924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:19.819572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:19.819572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:19.831786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:19.838847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:19.887756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:19.888602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5d60-7afe-44a8-8884-bdd9b876136e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:19.893534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:19.905772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:19.907960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:19.909281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:19.910605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] PATH_INFO: `/v3/projects/728a674f0a9f4b66837fe5662b210a20` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:19.912891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=728a674f0a9f4b66837fe5662b210a20)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:19.917695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:20.056325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728a674f0a9f4b66837fe5662b210a20', 'request_id': 'req-0d2be1ac-6709-4075-afc0-aa78b8c22a71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.083890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728a674f0a9f4b66837fe5662b210a20', 'request_id': 'req-0d2be1ac-6709-4075-afc0-aa78b8c22a71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.105581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728a674f0a9f4b66837fe5662b210a20', 'request_id': 'req-0d2be1ac-6709-4075-afc0-aa78b8c22a71'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.150336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] The token cache is being invalidate because project 728a674f0a9f4b66837fe5662b210a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:20.151213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.153102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.157162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 678/1342] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:19 2022] DELETE /identity/v3/projects/728a674f0a9f4b66837fe5662b210a20 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:20.161070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:20.162705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:20.164742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 665/1343] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:20.233712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:20.237281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:20.270846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0007-89da-4a73-b7cb-41928fecc7ce None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:20.375353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2be1ac-6709-4075-afc0-aa78b8c22a71 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:20.405592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:20.410914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:20.413924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:20.416941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] PATH_INFO: `/v3/users/876d525139c64f8697be74ef76a0a757` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:20.422031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876d525139c64f8697be74ef76a0a757)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:20.425959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: WARNING py.warnings [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:55:20.425959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: warnings.warn(msg) Oct 14 17:55:20.425959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: Oct 14 17:55:20.435781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:20.481078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:20.483108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:20.483784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:20.484769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:20.496226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:20.528192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:20.536088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2059-f4f9-419f-b86e-3c658a5bedb4 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:20.580768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 666/1344] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:20.675990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:20.735890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876d525139c64f8697be74ef76a0a757'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.740103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876d525139c64f8697be74ef76a0a757'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.766688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876d525139c64f8697be74ef76a0a757'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.771288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876d525139c64f8697be74ef76a0a757'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.827773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876d525139c64f8697be74ef76a0a757'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:20.908984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 679/1345] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:20 2022] DELETE /identity/v3/users/876d525139c64f8697be74ef76a0a757 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:22.499026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:22.499565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:22.499662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:22.589076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] MFA Rules not processed for user `6a5d2cb64aa841d0b3303581aaf3d36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:22.590294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:22.659637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:22.779523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 667/1346] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:22.802945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:22.804909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:22.919432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:22.920892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:22.979385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6158b-5505-41a5-b6d5-ec450ad6da76 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:22.994463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:22.995218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:22.995761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:22.995873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.021965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:23.026630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:23.049782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 680/1347] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:23.116565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d1822-e281-46f5-b6da-185fea289ff9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:23.126340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:23.127731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:23.128177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:23.128459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] PATH_INFO: `/v3/users/4ac0b10bd13843169665e23ea4ad7c74` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.138820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac0b10bd13843169665e23ea4ad7c74)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:23.141202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:23.174370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:23.176342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:23.212982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93cbae-ba62-4363-a1cb-0266df26a6a8 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:23.240824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:23.241487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:23.241765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:23.242035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] PATH_INFO: `/v3/users/041b4ce1cbee449aa9c66862435f8a9a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.246536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=041b4ce1cbee449aa9c66862435f8a9a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:23.248745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:23.272935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac0b10bd13843169665e23ea4ad7c74'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.273884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac0b10bd13843169665e23ea4ad7c74'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.307044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac0b10bd13843169665e23ea4ad7c74'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.308460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac0b10bd13843169665e23ea4ad7c74'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.332754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac0b10bd13843169665e23ea4ad7c74'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.414170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 668/1348] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:22 2022] DELETE /identity/v3/users/4ac0b10bd13843169665e23ea4ad7c74 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:23.417108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:23.429107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:23.447362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041b4ce1cbee449aa9c66862435f8a9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.450297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041b4ce1cbee449aa9c66862435f8a9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.488029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041b4ce1cbee449aa9c66862435f8a9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.493737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041b4ce1cbee449aa9c66862435f8a9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.519230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8190c71-ee3d-4133-9dd0-5d6e91164acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041b4ce1cbee449aa9c66862435f8a9a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:23.592064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 681/1349] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:23 2022] DELETE /identity/v3/users/041b4ce1cbee449aa9c66862435f8a9a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:23.592064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb696c6-1ff9-489b-999f-4b9cf9133594 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:23.592064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb696c6-1ff9-489b-999f-4b9cf9133594 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:23.592064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb696c6-1ff9-489b-999f-4b9cf9133594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.606257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:23.666773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3cb696c6-1ff9-489b-999f-4b9cf9133594 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:23.667916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7d9ad-a955-4d58-a933-3b03de33e14f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:23.668045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3cb696c6-1ff9-489b-999f-4b9cf9133594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:23.705669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:23.827613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:23.831029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:23.831751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:23.831937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] PATH_INFO: `/v3/projects/3a5c76f2513948e094870eade4105e32` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.835935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5c76f2513948e094870eade4105e32)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:23.840578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: WARNING py.warnings [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 17:55:23.840578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: warnings.warn(msg) Oct 14 17:55:23.840578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: Oct 14 17:55:23.841988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:23.861557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 682/1350] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:23.864236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd569-d675-4140-8180-97880e358abe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:23.864705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd569-d675-4140-8180-97880e358abe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:23.865135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd569-d675-4140-8180-97880e358abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:23.983685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5c76f2513948e094870eade4105e32', 'request_id': 'req-9dd75ad3-6664-4cea-a8bb-616087d73115'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.002628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5c76f2513948e094870eade4105e32', 'request_id': 'req-9dd75ad3-6664-4cea-a8bb-616087d73115'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.016649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5c76f2513948e094870eade4105e32', 'request_id': 'req-9dd75ad3-6664-4cea-a8bb-616087d73115'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.046034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] The token cache is being invalidate because project 3a5c76f2513948e094870eade4105e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:24.048382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.050580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.054600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 669/1351] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:23 2022] DELETE /identity/v3/projects/3a5c76f2513948e094870eade4105e32 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:24.056598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.058621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.194912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0b0dd569-d675-4140-8180-97880e358abe None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:24.196264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b0dd569-d675-4140-8180-97880e358abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.214478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd75ad3-6664-4cea-a8bb-616087d73115 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.232795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.233441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.233718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.236421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.243171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.320990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 683/1352] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:24.325474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61610d9-a079-4934-95eb-5d5a942d7733 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.325755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61610d9-a079-4934-95eb-5d5a942d7733 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.326197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61610d9-a079-4934-95eb-5d5a942d7733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.340262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:24.376009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a61610d9-a079-4934-95eb-5d5a942d7733 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:24.377757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a61610d9-a079-4934-95eb-5d5a942d7733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.397181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 684/1353] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:24.407528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf388-4521-4965-99fc-15059b180492 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.408546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf388-4521-4965-99fc-15059b180492 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.409001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bf388-4521-4965-99fc-15059b180492 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.415103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 685/1354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:55:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:24.416797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.417296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.417766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.433979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:24.436679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:24.461992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:24.463640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.466088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 670/1355] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:24.468300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.472897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.481977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 686/1356] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:24.486863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.499161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fec05c-aa39-4d4e-9924-111e3fb3386e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.507798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.508803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.509301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.509929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.510865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:24.511444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:24.512904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7618-5fb0-49aa-8e4f-fb6974334c55 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.513541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf16446-b746-421c-bb4f-38dd680a1bd9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:24.535218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.537176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.537753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.538954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 687/1357] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:24.540427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.540683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.540942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.541242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.571512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:24.573351 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.583545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:24.590006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:24.649107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 671/1358] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:24.653810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.685250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44512-50e6-447e-b475-0d297568d60c service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.698120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.699422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.699712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.699988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.700749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:24.705538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 688/1359] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:55:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:24.707740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:24.708445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.712953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.753182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963bc27-8e0f-4028-943f-b8cb460e8ff9 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.768337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.769067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.769557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 672/1360] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:24 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:24.770460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:24.774911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.775264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] PATH_INFO: `/v3/users/a961d3cd2f484100a041f733e02c319f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.779064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a961d3cd2f484100a041f733e02c319f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:24.779213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:24.784085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:24.827752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:24.909100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a961d3cd2f484100a041f733e02c319f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.911636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a961d3cd2f484100a041f733e02c319f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.933233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a961d3cd2f484100a041f733e02c319f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.934826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a961d3cd2f484100a041f733e02c319f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.960213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7277-da4c-49bd-addf-8dcd7e33dc17 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:24.968503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a961d3cd2f484100a041f733e02c319f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:24.972919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:24.973588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:24.973836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:24.974106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:24.977810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:25.019159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:25.021463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:25.024524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 689/1361] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:24 2022] DELETE /identity/v3/users/a961d3cd2f484100a041f733e02c319f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:25.027820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:25.032186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:25.048689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 673/1362] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:25.229812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a814e-dc48-4b15-8973-d5b6daf844a6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:25.236516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:25.238474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:25.238831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:25.239050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:25.240009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:25.241995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:25.291151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 690/1363] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:25 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:25.296040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:25.445867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4cd7-094b-497c-b6a7-594e07836233 service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:25.464219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:25.464583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:25.464866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:25.465138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:25.465793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:25.467597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:25.493441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 674/1364] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:25.497603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:25.512979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93a46-0ce1-4bd1-a45f-4afa2a1061b7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:25.524191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:25.525216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:25.529306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:25.529939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:25.530882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:25.534428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeab43-0f81-423e-8ea8-f2b97ccada77 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:25.559408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 691/1365] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:25.562633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:25.582210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ace0ed-d9cc-4fe6-b4c4-238091e169e3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:25.606447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:25.607386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:25.607866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:25.608301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] PATH_INFO: `/v3/projects/08900ca210d3421abe9cba44f1f4d6d3/users/a9f713322018467caaa21de14988839c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:25.648282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:25.675736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=08900ca210d3421abe9cba44f1f4d6d3, user_id=a9f713322018467caaa21de14988839c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:25.690125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:25.734665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:25.735304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:25.736272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:25.748985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 675/1366] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:25 2022] PUT /identity/v3/projects/08900ca210d3421abe9cba44f1f4d6d3/users/a9f713322018467caaa21de14988839c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:25.793219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] MFA Rules not processed for user `a9f713322018467caaa21de14988839c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:25.795078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:25.958344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 692/1367] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:25.963105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.062109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.064064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:26.071452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:26.110553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f26ff7-17fc-4a9f-8929-85c09229a0fe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:26.116782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:26.117423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:26.117704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:26.117982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:26.118627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:26.120602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:26.173265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 676/1368] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:25 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:26.174571 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.256728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7bb4-4e3d-4bd5-b543-25a37475dd77 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:26.313107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904e974-4720-4550-a9d5-5b6c044a8edd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:26.323296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:26.324267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:26.325275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:26.325726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:26.326731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:26.329296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:26.380681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 677/1369] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:26 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:26.384201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.416178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d0de5-0805-4dad-b3d7-f292f6dc6f79 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:26.432961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:26.433092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:26.433362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:26.434174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:26.458134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:26.458554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:26.460178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:26.462621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:26.482368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] PATH_INFO: `/v3/projects/c6b8021789d24b2594ed7008ad484506` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:26.483021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:26.485614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b8021789d24b2594ed7008ad484506)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:26.496861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:26.540798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 678/1370] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:26.542060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.547894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:26.583067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f9abc-756b-441c-9366-f847377f1586 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:26.591862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:26.592514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:26.592791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:26.593050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] PATH_INFO: `/v3/projects/11f298e50a654f40b16b056582daf3fa` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:26.594865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f298e50a654f40b16b056582daf3fa)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:26.597641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:26.695271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b8021789d24b2594ed7008ad484506', 'request_id': 'req-9049a9ab-df27-4842-b6c0-9af71a10da9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.722558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b8021789d24b2594ed7008ad484506', 'request_id': 'req-9049a9ab-df27-4842-b6c0-9af71a10da9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.732654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b8021789d24b2594ed7008ad484506', 'request_id': 'req-9049a9ab-df27-4842-b6c0-9af71a10da9b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.764340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] The token cache is being invalidate because project c6b8021789d24b2594ed7008ad484506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:26.764735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.769457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.779765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 693/1371] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:26 2022] DELETE /identity/v3/projects/c6b8021789d24b2594ed7008ad484506 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:26.779765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.782060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:26.793396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f298e50a654f40b16b056582daf3fa', 'request_id': 'req-0fe06b5a-904f-4a1d-8e4d-c058328397d6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.795362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:26.810490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f298e50a654f40b16b056582daf3fa', 'request_id': 'req-0fe06b5a-904f-4a1d-8e4d-c058328397d6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.835006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f298e50a654f40b16b056582daf3fa', 'request_id': 'req-0fe06b5a-904f-4a1d-8e4d-c058328397d6'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.862237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] The token cache is being invalidate because project 11f298e50a654f40b16b056582daf3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:26.902724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.902724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:26.902724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 679/1372] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:26 2022] DELETE /identity/v3/projects/11f298e50a654f40b16b056582daf3fa => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:26.902724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:26.902724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:26.920601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:26.964861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a9ab-df27-4842-b6c0-9af71a10da9b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:27.043833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe06b5a-904f-4a1d-8e4d-c058328397d6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:27.050910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:27.053626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.054091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.055040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] PATH_INFO: `/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8/users/4893a2ef8f6a471dac45afe890910400/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.090409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:27.091076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.091176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.091493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] PATH_INFO: `/v3/projects/89613423e69348da91ea084809b1f162` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.092665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89613423e69348da91ea084809b1f162)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:27.094991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:27.096243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ae29b7a3fd40ea92ea37d0861f19f8, user_id=4893a2ef8f6a471dac45afe890910400, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:27.099131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc067f-0c8d-406a-a5da-991c2ccf166d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:27.124848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 680/1373] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:26 2022] PUT /identity/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8/users/4893a2ef8f6a471dac45afe890910400/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:27.126938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.127647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.128092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.171967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] MFA Rules not processed for user `45850cb145004c0e996799927e2f5a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:27.174091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:27.234754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89613423e69348da91ea084809b1f162', 'request_id': 'req-e1165283-a4d2-4420-823e-2d4548af5b1e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.250049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89613423e69348da91ea084809b1f162', 'request_id': 'req-e1165283-a4d2-4420-823e-2d4548af5b1e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.265260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89613423e69348da91ea084809b1f162', 'request_id': 'req-e1165283-a4d2-4420-823e-2d4548af5b1e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.291466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] The token cache is being invalidate because project 89613423e69348da91ea084809b1f162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:27.291813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.293170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.298711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 694/1374] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:26 2022] DELETE /identity/v3/projects/89613423e69348da91ea084809b1f162 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:27.298711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:27.299051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:27.341120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 681/1375] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:27.352349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:27.356215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:27.456982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:27.531228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0ccc-4ed9-499f-843d-60b9c9a772a6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:27.541064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1165283-a4d2-4420-823e-2d4548af5b1e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:27.543165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:27.544077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.544611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.544611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] PATH_INFO: `/v3/users/7d56f9b334cd413d985ec48af6ce9563` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.546091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d56f9b334cd413d985ec48af6ce9563)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:27.548093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:27.559837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:27.560596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.560823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.563509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] PATH_INFO: `/v3/users/aa02bd7926734642bb77e5c8ab7af994` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.565774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa02bd7926734642bb77e5c8ab7af994)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:27.586288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:27.649893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:27.670644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d56f9b334cd413d985ec48af6ce9563'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.673943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d56f9b334cd413d985ec48af6ce9563'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.706656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d56f9b334cd413d985ec48af6ce9563'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.708074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d56f9b334cd413d985ec48af6ce9563'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.724152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d56f9b334cd413d985ec48af6ce9563'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.752058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa02bd7926734642bb77e5c8ab7af994'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.752058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa02bd7926734642bb77e5c8ab7af994'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.773794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 682/1376] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:27 2022] DELETE /identity/v3/users/7d56f9b334cd413d985ec48af6ce9563 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:27.777933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:27.786332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:27.787839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa02bd7926734642bb77e5c8ab7af994'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.789417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa02bd7926734642bb77e5c8ab7af994'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.823666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-60d85a79-09b9-4951-a1ee-8788ab98f35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa02bd7926734642bb77e5c8ab7af994'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:27.901734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 695/1377] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:27 2022] DELETE /identity/v3/users/aa02bd7926734642bb77e5c8ab7af994 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:27.902344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da953b-f841-4aa9-94a6-31bed92913c7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:27.903143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954dad-8873-4cb9-b1ea-3d7cabea3ce0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:27.909313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954dad-8873-4cb9-b1ea-3d7cabea3ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:27.909609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954dad-8873-4cb9-b1ea-3d7cabea3ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:27.977818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0c954dad-8873-4cb9-b1ea-3d7cabea3ce0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:27.979405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c954dad-8873-4cb9-b1ea-3d7cabea3ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.052851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:28.053502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.053786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.054062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.057414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:28.061155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c7cc8-38e0-4e4f-8e4e-26dc02d84af3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:28.092691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 683/1378] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:28.094909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.095234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.096556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.131108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 696/1379] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:28.146869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb263f-84d8-426f-81dd-2f4c5152dd7d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.147165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb263f-84d8-426f-81dd-2f4c5152dd7d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.147484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb263f-84d8-426f-81dd-2f4c5152dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.188842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] MFA Rules not processed for user `45850cb145004c0e996799927e2f5a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:28.194276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.219295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:28.237171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dacb263f-84d8-426f-81dd-2f4c5152dd7d None None] MFA Rules not processed for user `57705b9fa1544050b59d5bf298d66931`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:28.237171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dacb263f-84d8-426f-81dd-2f4c5152dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.356030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 684/1380] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:28.369869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:28.376696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.386538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 697/1381] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:28.387893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.388695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.389072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.426755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa058dd-dc31-48cd-9134-ebb2b5ed4ce7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:28.448537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:28.449465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.450025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.450585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] PATH_INFO: `/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8/users/4893a2ef8f6a471dac45afe890910400/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.453023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ae29b7a3fd40ea92ea37d0861f19f8, user_id=4893a2ef8f6a471dac45afe890910400, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:28.456891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:28.481166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 685/1382] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:28 2022] PUT /identity/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8/users/4893a2ef8f6a471dac45afe890910400/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:28.482979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:28.485101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:28.485473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.492710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.536873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:28.590405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88475170-25d2-444c-83e8-3d5151e3b1a9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:28.597261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:28.598111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.598399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.598850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.600851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.650554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 698/1383] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:28.651640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:28.653060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.688006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901dec-4048-4497-b707-fd38e98ce6f1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:28.701563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:28.702202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.702623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.702788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.797574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:28.800025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:28.802644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:28.804500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c72935-09cb-4c02-89bb-5eb72c88435c service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:28.823707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 699/1384] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:28.825247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.825694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.826122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.853395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 686/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:28.869605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:28.877305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] MFA Rules not processed for user `4893a2ef8f6a471dac45afe890910400`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:28.878973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:28.897068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f9b2c-dd94-468a-bf9b-59fc4a2b6107 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:28.916003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:28.918045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:28.918336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:28.918608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:28.919305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:28.919605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:28.928445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:28.969287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 687/1386] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:28.970307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:28.976073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.016204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307ced9-f1c7-41b8-9b0a-8118c7214649 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.034907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.036066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.036411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.036703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] PATH_INFO: `/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.038122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20ad8dd7b754a4ca11fa79e3fa14b21)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.040773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.131797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:29.168812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 700/1387] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:29.168812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:29.181885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20ad8dd7b754a4ca11fa79e3fa14b21', 'request_id': 'req-d615f432-9cef-47ff-8e94-f0cf4b9b26db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.192299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fad57-e16a-417f-82f8-f6a90f55ade7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.196175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20ad8dd7b754a4ca11fa79e3fa14b21', 'request_id': 'req-d615f432-9cef-47ff-8e94-f0cf4b9b26db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.218180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20ad8dd7b754a4ca11fa79e3fa14b21', 'request_id': 'req-d615f432-9cef-47ff-8e94-f0cf4b9b26db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.243672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] The token cache is being invalidate because project c20ad8dd7b754a4ca11fa79e3fa14b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:29.246845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.255821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.257870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 688/1388] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:28 2022] DELETE /identity/v3/projects/c20ad8dd7b754a4ca11fa79e3fa14b21 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:29.258744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:29.260405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.312977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:29.333201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.333850 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.334124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.334389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.335678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.336984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.383546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f432-9cef-47ff-8e94-f0cf4b9b26db admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.397689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 701/1389] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:29 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:29.400305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.401063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.401348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.401625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] PATH_INFO: `/v3/projects/a349f2d84aa64c8aae6b788a23d86a1d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.401856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:29.402882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a349f2d84aa64c8aae6b788a23d86a1d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.403673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.404886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.491993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a349f2d84aa64c8aae6b788a23d86a1d', 'request_id': 'req-1209c9fc-3ab2-418a-953b-ffd606fa61bb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.508545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a349f2d84aa64c8aae6b788a23d86a1d', 'request_id': 'req-1209c9fc-3ab2-418a-953b-ffd606fa61bb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.522803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf551d-4120-41f9-9935-e989a79eb13d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.529708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a349f2d84aa64c8aae6b788a23d86a1d', 'request_id': 'req-1209c9fc-3ab2-418a-953b-ffd606fa61bb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.552411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] The token cache is being invalidate because project a349f2d84aa64c8aae6b788a23d86a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:29.552703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.554760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1209c9fc-3ab2-418a-953b-ffd606fa61bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:29.563246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 689/1390] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:29 2022] DELETE /identity/v3/projects/a349f2d84aa64c8aae6b788a23d86a1d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:29.566606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7111a-48e6-4ae0-b5e9-15675aa98549 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.566973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7111a-48e6-4ae0-b5e9-15675aa98549 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.569420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7111a-48e6-4ae0-b5e9-15675aa98549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.619853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5af7111a-48e6-4ae0-b5e9-15675aa98549 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:29.628599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5af7111a-48e6-4ae0-b5e9-15675aa98549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.668157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.669131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.669479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.669757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.671762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.725514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:29.759791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 690/1391] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:29.761393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404036-e916-44b1-82b8-80671c7ac082 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.761895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404036-e916-44b1-82b8-80671c7ac082 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.762177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5404036-e916-44b1-82b8-80671c7ac082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.773473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.776061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.791843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 702/1392] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:29.793012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:29.795671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.817120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b5404036-e916-44b1-82b8-80671c7ac082 None None] MFA Rules not processed for user `5cd61d7e706d46c6992c7abbbfc4b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:29.818929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b5404036-e916-44b1-82b8-80671c7ac082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.821903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525058-f061-4b49-ae28-45fdcc91c0f6 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.830953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.831888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.832184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.832452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.833151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.835101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.889401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 703/1393] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:29 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:29.890659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:29.893082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:29.930835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e27580-118c-4411-8917-682715b3c50c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:29.943742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:29.946074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.948616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.949061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] PATH_INFO: `/v3/users/b9d6f733dc27469a806617d0d8410d79` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:29.952474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d6f733dc27469a806617d0d8410d79)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:29.957455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:29.966070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 691/1394] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:29.968362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7716-cd7b-491e-a7f9-ad420a2fc2ee None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:29.968907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7716-cd7b-491e-a7f9-ad420a2fc2ee None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:29.969766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7716-cd7b-491e-a7f9-ad420a2fc2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.034271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-db7e7716-cd7b-491e-a7f9-ad420a2fc2ee None None] MFA Rules not processed for user `6a5d2cb64aa841d0b3303581aaf3d36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:30.036903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-db7e7716-cd7b-491e-a7f9-ad420a2fc2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:30.044372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:30.124936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d6f733dc27469a806617d0d8410d79'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:30.128606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d6f733dc27469a806617d0d8410d79'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:30.150355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d6f733dc27469a806617d0d8410d79'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:30.152229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d6f733dc27469a806617d0d8410d79'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:30.181916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 692/1395] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:30.183854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.184334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.184859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.187524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d3deb60f-3891-470a-8ffa-93d5c551af49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d6f733dc27469a806617d0d8410d79'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:30.214395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:30.215993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:30.231481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 693/1396] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:30.232751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.239118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:30.259338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef38e2f-3cde-43e0-93bd-8bc14b47703a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.272402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 704/1397] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:29 2022] DELETE /identity/v3/users/b9d6f733dc27469a806617d0d8410d79 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:30.275389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.275389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.275389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.338445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] MFA Rules not processed for user `5cd61d7e706d46c6992c7abbbfc4b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:30.341416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:30.541006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.541896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.542408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.542825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.543852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.546085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a6e96-8e84-42c9-a287-0e7cb388c75d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.571655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 694/1398] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:30.571655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2f69-037d-4be1-a131-21ef2e95cd51 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.571655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2f69-037d-4be1-a131-21ef2e95cd51 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.571655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2f69-037d-4be1-a131-21ef2e95cd51 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.574244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 705/1399] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:30.575213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.580852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 695/1400] 10.222.0.26 () {54 vars in 912 bytes} [Fri Oct 14 17:55:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:30.585438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca2f69-037d-4be1-a131-21ef2e95cd51 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.596830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8e1a6-ab78-4053-b5ae-ee9a56ff3c09 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.613008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.613645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.613988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.614293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.614954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:30.615251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.616944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c385d-c361-4a00-86fe-b75c659cf9ee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.627580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca2f69-037d-4be1-a131-21ef2e95cd51 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.634137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.635059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.637477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.637956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.639106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.641408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.643455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:30.645212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 706/1401] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:30.648451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.649203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.649676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.666039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 696/1402] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:30.667783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.710430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:30.712036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:30.713229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0ff8-639a-480c-9b9b-8be921d8461d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.737642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.738270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.738537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.738804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.739607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.744972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.796574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 697/1403] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:30 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:30.798764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 707/1404] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:30.799774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.801809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.819081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c1b7d-67ab-4004-a93c-4ee153c590ad None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.875821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:30.901791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb992596-8282-4a6b-9f8a-38ee8a635601 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:30.909050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.910773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.911438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.912131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] PATH_INFO: `/v3/projects/58938e76fa104a8f83b14717c67ca068/users/b50f32ad809746568505281866815dd9/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.935113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58938e76fa104a8f83b14717c67ca068, user_id=b50f32ad809746568505281866815dd9, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.944094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.948643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:30.948643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:30.948994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:30.949184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:30.950635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:30.957518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe3156-492b-4888-b7d9-848c5d05baa6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:30.971308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 698/1405] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:30 2022] PUT /identity/v3/projects/58938e76fa104a8f83b14717c67ca068/users/b50f32ad809746568505281866815dd9/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:30.983474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:30.986098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.000083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 708/1406] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:30 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:31.001402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.001680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.002696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.066593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bffc0-5659-4e48-bf3c-1caadf01e35f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.071896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.072524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.072803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.073109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.080285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] MFA Rules not processed for user `b50f32ad809746568505281866815dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:31.081843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.085770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.087776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.100503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 699/1407] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:31.101416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.216761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fdb93-02d9-4f4f-9c67-2f55ac6387fe service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.233184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.234110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.234541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.234948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.238231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.240151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.248820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:31.260883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 709/1408] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:31.261860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.264527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.287878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 700/1409] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:31.289270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.294882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada270e-0a5e-498a-adbb-294825b4c774 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.310344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.311002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.311303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.311578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] PATH_INFO: `/v3/projects/d40b3220c34e4a719e649366068b4589` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.314835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40b3220c34e4a719e649366068b4589)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.317276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.324355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02dde-1bf8-4b52-bc40-ce5f05a08d43 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.332197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.333448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.333924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.334452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.335346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.337601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.397119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 701/1410] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:31 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:31.398068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.455741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40b3220c34e4a719e649366068b4589', 'request_id': 'req-ed414152-d74b-4cdb-8243-0c1e37a2e651'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:31.468019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40b3220c34e4a719e649366068b4589', 'request_id': 'req-ed414152-d74b-4cdb-8243-0c1e37a2e651'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:31.479793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40b3220c34e4a719e649366068b4589', 'request_id': 'req-ed414152-d74b-4cdb-8243-0c1e37a2e651'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:31.495336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] The token cache is being invalidate because project d40b3220c34e4a719e649366068b4589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:31.495755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:31.496532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:31.498141 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 710/1411] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:31 2022] DELETE /identity/v3/projects/d40b3220c34e4a719e649366068b4589 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:31.504959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.506553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.521727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63439b6e-bbb4-419b-8cb4-e847ba83c16e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.586703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:31.654714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed414152-d74b-4cdb-8243-0c1e37a2e651 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.661999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.662974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.664402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.666271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.666703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.668711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae718a-44cd-4d35-9996-57d0a8a6f25b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.702888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.703712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.704005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.704798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.708512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.709778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.733508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 711/1412] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:31 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:31.733508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee36e-c987-4632-a4f5-b5e582e7987f None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.734389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee36e-c987-4632-a4f5-b5e582e7987f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.734562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee36e-c987-4632-a4f5-b5e582e7987f None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.743031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 712/1413] 10.222.0.26 () {54 vars in 912 bytes} [Fri Oct 14 17:55:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:31.749217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.749454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 702/1414] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:31.749454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.749574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.750675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.785810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccd769-1646-4ecc-aa3b-47aed20791f9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.797427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.798764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.799158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.799738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.800320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.802896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:31.804468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc173fbe-c143-496c-a79a-776aa0869f99 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.806645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.823013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 703/1415] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:31.832700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 713/1416] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:31.833683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:31.835455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1230c6-411e-4a53-9f3a-57029c61fb20 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.835803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1230c6-411e-4a53-9f3a-57029c61fb20 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.835986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1230c6-411e-4a53-9f3a-57029c61fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.839335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.865440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb242b6-e28b-4fd9-b6ec-e2ce163e93ed None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:31.877081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:31.877757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:31.878032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:31.878341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] PATH_INFO: `/v3/projects/56e2754ab3314c4ca5338cedb15fea0c/users/e83c398571d046a1aad2835d53e2cc46/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:31.885093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fa1230c6-411e-4a53-9f3a-57029c61fb20 None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:31.893905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fa1230c6-411e-4a53-9f3a-57029c61fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:31.917281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e2754ab3314c4ca5338cedb15fea0c, user_id=e83c398571d046a1aad2835d53e2cc46, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:31.923542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:31.962595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 714/1417] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:31 2022] PUT /identity/v3/projects/56e2754ab3314c4ca5338cedb15fea0c/users/e83c398571d046a1aad2835d53e2cc46/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:31.962595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.040472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 704/1418] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:32.042490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.042905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.043437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.081871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:32.083224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.097527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:32.104050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39cd56-efb5-4575-a5fc-8369b2d417ac admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.109955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.110707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.110988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.111258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] PATH_INFO: `/v3/projects/22665380e49649bf8aadd03fecc019b9/users/11c887fc5c994b13a1df7284ab70f7cc/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.139646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=22665380e49649bf8aadd03fecc019b9, user_id=11c887fc5c994b13a1df7284ab70f7cc, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.143542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31e876-d3d3-4497-8267-86d24dd083cf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.169568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 715/1419] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:31 2022] PUT /identity/v3/projects/22665380e49649bf8aadd03fecc019b9/users/11c887fc5c994b13a1df7284ab70f7cc/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:32.174097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.174647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.175161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.186344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 705/1420] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:32.187252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.189360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.211791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] MFA Rules not processed for user `e83c398571d046a1aad2835d53e2cc46`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:32.213126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.314592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 716/1421] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:32.320530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.323364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.336912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:32.369030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71012c1e-c778-467a-b520-a6f4cbada6de None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.420676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3af58-d478-4bf2-a817-f34e10d5ffcb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.426146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.426977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.427430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.428321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.440172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.441794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.450468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.450854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 717/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:32.451090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.451622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.452983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.459410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.459894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.462107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.541819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:32.565851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.569210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.587538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832d85b-4b53-467c-8d95-02a725131da3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.592938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.593560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.593842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.594114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.596210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.609990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.612237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 706/1423] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:32.613218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.613335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.647264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 718/1424] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:32.648279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.779178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba2a01-3b48-44b0-938e-bf3e3a3750e0 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.786971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.788078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.788495 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.788941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.789609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:32.789913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.792393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.802252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3f135-ed9c-4888-b72d-1cc0c68701e5 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.814882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.815562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.815928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.816200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.816935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.820657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d01581-7015-449e-abe1-d5b82bef45c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.822161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 719/1425] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:32.823189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.844108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937885db-8aaf-486a-b190-07d873312663 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:32.849997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:32.850775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.851059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.851359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.852003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:32.853959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:32.857272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 707/1426] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:32.865093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:32.865490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:32.865764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:32.909089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 720/1427] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:32 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:32.910487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:32.917482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] MFA Rules not processed for user `57705b9fa1544050b59d5bf298d66931`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:32.921853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:32.931601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:33.047319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 708/1428] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:33.050175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:33.066023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd701-bd29-42a1-916b-a5513fd7fb03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.072120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.073830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.074324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.074936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.076002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.080516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:33.127269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 721/1429] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:32 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:33.128374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:33.222794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb398-391b-486e-b43f-57eb72f46549 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.281917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb68b-d2ec-48fe-8fbb-7c7d399d6e6f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.294438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.295846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.297606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.298360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.299217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.301627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:33.335392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:33.407968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.408617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 722/1430] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:33 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:33.409076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.409233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.409624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] PATH_INFO: `/v3/projects/22665380e49649bf8aadd03fecc019b9/users/11c887fc5c994b13a1df7284ab70f7cc/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.411972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:33.413061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22665380e49649bf8aadd03fecc019b9, user_id=11c887fc5c994b13a1df7284ab70f7cc, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.416550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:33.451717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f3e7d-ca86-4b32-84c4-2732358e90a1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.475009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 709/1431] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:33 2022] PUT /identity/v3/projects/22665380e49649bf8aadd03fecc019b9/users/11c887fc5c994b13a1df7284ab70f7cc/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:33.476470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:33.490512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:33.672168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.673170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.673506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.673808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.674462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.700725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:33.713214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b729-9c9a-4539-9c61-0af9c7d18b95 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.726355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.727174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.727296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.727562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.733505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:33.745317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 723/1432] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:33 2022] POST /identity/v3/users => generated 291 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:33.745317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:33.778513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bca4e-7e23-496c-a088-ad434de25494 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:33.793385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:33.794343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.794795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.795234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.796093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.799143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83de7e-cc1b-4f21-801e-1232402cffe8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:33.815648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:33.837197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 724/1433] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:33.838803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:33.840514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:33.840893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:33.920612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] MFA Rules not processed for user `11c887fc5c994b13a1df7284ab70f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:33.924943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:33.962677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:33.967458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.003796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 710/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:34.006517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.036356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a4f11-b179-48b7-8e7f-deb2dc6a391f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.056241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.057043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.058856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.059161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.059979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.068044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.138346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 711/1435] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:34.145786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.184902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b405a0-6578-4d01-994a-0aef7f20b16d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.203665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.204953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 725/1436] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:34.206941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.207239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.208056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] PATH_INFO: `/v3/projects/2336e42698d14a079ee6e68584e47ec0/users/0ac90f4063b5421bbd56e89e86e4fa5b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.210232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.241192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcb63f-9716-456c-ae11-174801f426d2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.259403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.260532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.261019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2336e42698d14a079ee6e68584e47ec0, user_id=0ac90f4063b5421bbd56e89e86e4fa5b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.263004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.263470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.265785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.268233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.270081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.305518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 712/1437] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:34 2022] PUT /identity/v3/projects/2336e42698d14a079ee6e68584e47ec0/users/0ac90f4063b5421bbd56e89e86e4fa5b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:34.307173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.311738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:34.330161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 726/1438] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:34.331380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.375765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9726-3847-4f63-89b1-e3810658944e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.538686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:34.570966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fc79-37a9-4367-9f3d-d7b1d9692277 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.580659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.582084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.582732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.583312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.742292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.742881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.743170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.749805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.752323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.753955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.807386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 727/1439] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:34.808279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:34.850216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912679c9-de2d-4653-a360-c3fb28062f35 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:34.863814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:34.864506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.864791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.865067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] PATH_INFO: `/v3/projects/d120e229ac834915b049d110cb2160ca/users/6691207158ab410c9a0c64a9935960c8/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.878710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.881458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741bd37-91aa-45b2-98b8-9852268559d9 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.916711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 713/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:34.922176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c04c9-82aa-4901-ac23-99a2c5a7d650 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:34.924694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c04c9-82aa-4901-ac23-99a2c5a7d650 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:34.924996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c04c9-82aa-4901-ac23-99a2c5a7d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:34.927049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d120e229ac834915b049d110cb2160ca, user_id=6691207158ab410c9a0c64a9935960c8, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:34.929829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:34.977507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 728/1441] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:34 2022] PUT /identity/v3/projects/d120e229ac834915b049d110cb2160ca/users/6691207158ab410c9a0c64a9935960c8/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:34.978695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:35.002102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b88c04c9-82aa-4901-ac23-99a2c5a7d650 None None] MFA Rules not processed for user `5cd61d7e706d46c6992c7abbbfc4b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:35.003450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b88c04c9-82aa-4901-ac23-99a2c5a7d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:35.214019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:35.261751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de87d5-4b7b-43a6-bbe2-c0cffc5d0c4b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:35.275968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:35.277188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:35.277699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:35.278216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] PATH_INFO: `/v3/projects/2336e42698d14a079ee6e68584e47ec0/users/0ac90f4063b5421bbd56e89e86e4fa5b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:35.284705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2336e42698d14a079ee6e68584e47ec0, user_id=0ac90f4063b5421bbd56e89e86e4fa5b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:35.290769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:35.305079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 714/1442] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:35.311075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361441-05b1-4d55-b0e2-b6f3468afa93 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:35.311471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361441-05b1-4d55-b0e2-b6f3468afa93 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:35.311679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361441-05b1-4d55-b0e2-b6f3468afa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:35.323596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 729/1443] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:34 2022] PUT /identity/v3/projects/2336e42698d14a079ee6e68584e47ec0/users/0ac90f4063b5421bbd56e89e86e4fa5b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:35.324706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:35.569121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b682d-f8d2-45cf-84e7-1baf0b678dde admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:35.573481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c2361441-05b1-4d55-b0e2-b6f3468afa93 None None] MFA Rules not processed for user `6691207158ab410c9a0c64a9935960c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:35.575052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c2361441-05b1-4d55-b0e2-b6f3468afa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:35.578332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:35.579740 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:35.580192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:35.580448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:35.586497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:35.731754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 715/1444] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:35.737100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:35.737390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:35.737658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:35.821744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:35.825859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:35.856147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] MFA Rules not processed for user `0ac90f4063b5421bbd56e89e86e4fa5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:35.858570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:35.863644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 730/1445] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:35.869023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:35.932196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:36.087624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 716/1446] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:36.101283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.128660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc2361-07d1-44bd-95b2-e1de4899b89f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.139184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719d03d-722d-4887-a0d2-53d44b05d16c service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.142287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.144039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.146515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.147189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.152767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.155773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.159503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.160154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.162401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.168261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.180820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.184049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.233492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 717/1447] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:36.270516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 731/1448] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:35 2022] POST /identity/v3/projects => generated 383 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:36.275267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.289359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14d10b-8023-4592-be70-cd24ad1d4d2f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.456931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.462086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.462460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.462813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.463568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.465748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.492101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.509349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543738e9-df30-4401-9908-5562bfe5e8cc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.533353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.533353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.535502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.535867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] PATH_INFO: `/v3/users/e83c398571d046a1aad2835d53e2cc46` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.536817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 718/1449] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:36 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:36.538779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.539874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83c398571d046a1aad2835d53e2cc46)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.557930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.576715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31355031-ab3d-4b4f-a6f5-57927ca46d99 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.610068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.611034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.611364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.611644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.612321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.613928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.614112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:36.653980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 719/1450] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:36.658867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.679410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c575-c018-4a15-a78d-5c1ce1296434 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.698647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:36.700341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.700739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.701168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] PATH_INFO: `/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3/users/2e065fc1aa854793ac0aff224fc128b5/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.716935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83c398571d046a1aad2835d53e2cc46'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:36.721883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83c398571d046a1aad2835d53e2cc46'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:36.726145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91ebaff4de46328b7cc12a8313c6e3, user_id=2e065fc1aa854793ac0aff224fc128b5, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:36.729433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:36.742724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83c398571d046a1aad2835d53e2cc46'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:36.745291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83c398571d046a1aad2835d53e2cc46'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:36.751937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 720/1451] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:36 2022] PUT /identity/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3/users/2e065fc1aa854793ac0aff224fc128b5/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:36.755890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:36.760012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:36.765234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9c0cf3de-fa82-46ae-af8a-fe15146d7b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83c398571d046a1aad2835d53e2cc46'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:36.872209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 732/1452] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:36 2022] DELETE /identity/v3/users/e83c398571d046a1aad2835d53e2cc46 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:36.874668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:36.876449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:36.876966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:36.934459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea88e97-6300-47bc-9b9e-f9476e465394 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:36.941854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:36.943118 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:36.953137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:37.169138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:37.169890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.170098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.170369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:37.171085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:37.179542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:37.195487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 721/1453] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:55:37.199076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:37.224151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986952f1-b393-48fb-ad57-dd0386a5bdcb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:37.233964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 733/1454] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:37.240762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:37.244630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:37.245501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:37.248980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.253374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.253728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] PATH_INFO: `/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3/users/2e065fc1aa854793ac0aff224fc128b5/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:37.264283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91ebaff4de46328b7cc12a8313c6e3, user_id=2e065fc1aa854793ac0aff224fc128b5, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:37.278425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57c6b5-9b40-46ed-bde2-e5d5be3d0d8e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:37.311013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 722/1455] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:37 2022] PUT /identity/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3/users/2e065fc1aa854793ac0aff224fc128b5/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:37.326336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.326693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.326970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:37.443593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] MFA Rules not processed for user `2e065fc1aa854793ac0aff224fc128b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:37.446269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78707-9fe8-42b9-94aa-6b87d4a1f1af None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:37.450384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:37.724544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:37.734625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:37.739505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.741408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.741781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:37.747807 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 723/1456] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:37.769077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:37.770899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:37.950537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:37.952630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e529-0234-400e-888e-8226d2152c7a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:37.957810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb0215-bb9c-492c-bd7d-2b8815bdcaa1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:37.974312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:37.978992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 734/1457] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:37.982571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.983436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.985001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:37.987061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:37.987375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:37.987654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:38.027700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:38.029222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:38.074312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 724/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:38.202357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:38.208397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:38.418892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 735/1459] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:38.585169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:38.586909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:38.607641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418cb08-b1da-4f67-a69d-92d74af21655 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:38.640588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:38.644084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:38.644501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:38.644878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:38.650515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:38.717226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:38.808643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:38.810289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:38.868207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:38.873234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:38.898133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 725/1460] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:39.257488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:39.276881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913187a0-0288-4b5e-bf20-4015751f8552 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:39.297068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:39.311669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:39.311669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:39.311669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:39.344383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:39.346857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:39.371727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 736/1461] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 17:55:39.855326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:39.858229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:39.921998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8df16-caa5-44b0-aa2d-ab1fdfd4d21f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:39.969040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:39.969658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:39.969939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:39.970213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] PATH_INFO: `/v3/projects/56e2754ab3314c4ca5338cedb15fea0c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:39.979543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e2754ab3314c4ca5338cedb15fea0c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:39.981388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:40.189428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e2754ab3314c4ca5338cedb15fea0c', 'request_id': 'req-89495708-1b33-4081-8655-858096db2e9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.217375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e2754ab3314c4ca5338cedb15fea0c', 'request_id': 'req-89495708-1b33-4081-8655-858096db2e9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.248786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e2754ab3314c4ca5338cedb15fea0c', 'request_id': 'req-89495708-1b33-4081-8655-858096db2e9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.316370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] The token cache is being invalidate because project 56e2754ab3314c4ca5338cedb15fea0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:40.317352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.323390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.335942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 726/1462] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:39 2022] DELETE /identity/v3/projects/56e2754ab3314c4ca5338cedb15fea0c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:40.337890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:40.361110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641f3d-ac52-4862-bbed-4803634db43a service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:40.582950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:40.585833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:40.586066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:40.586626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] PATH_INFO: `/v3/users/0ac90f4063b5421bbd56e89e86e4fa5b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:40.588277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac90f4063b5421bbd56e89e86e4fa5b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:40.591508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:40.749050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac90f4063b5421bbd56e89e86e4fa5b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.749815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac90f4063b5421bbd56e89e86e4fa5b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.767865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac90f4063b5421bbd56e89e86e4fa5b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.768643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac90f4063b5421bbd56e89e86e4fa5b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.790509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c6367de9-b168-4cb4-a1d7-52c66e1c2fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac90f4063b5421bbd56e89e86e4fa5b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:40.835560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 737/1463] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:40 2022] DELETE /identity/v3/users/0ac90f4063b5421bbd56e89e86e4fa5b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:42.080886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:42.084607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:42.111732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89495708-1b33-4081-8655-858096db2e9d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:42.338544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:42.340776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:42.341051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:42.342545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] PATH_INFO: `/v3/users/6691207158ab410c9a0c64a9935960c8` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:42.348062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6691207158ab410c9a0c64a9935960c8)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:42.352983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:42.482939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:42.498918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6691207158ab410c9a0c64a9935960c8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:42.502490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6691207158ab410c9a0c64a9935960c8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:42.539689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6691207158ab410c9a0c64a9935960c8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:42.544153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6691207158ab410c9a0c64a9935960c8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:42.567847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6691207158ab410c9a0c64a9935960c8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:42.631078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 727/1464] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:42 2022] DELETE /identity/v3/users/6691207158ab410c9a0c64a9935960c8 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:42.633604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4cd6-7590-446f-9cb2-53b5ae2d0bdc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:42.634750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4cd6-7590-446f-9cb2-53b5ae2d0bdc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:42.635440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4cd6-7590-446f-9cb2-53b5ae2d0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:42.677262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f35c4cd6-7590-446f-9cb2-53b5ae2d0bdc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:42.678896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f35c4cd6-7590-446f-9cb2-53b5ae2d0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:42.807545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:42.841335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 738/1465] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:42.940020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:42.945313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:43.120717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd193b81-e4db-4cf3-b732-758f4fffb7f8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:43.132004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:43.132579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:43.132858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:43.133123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:43.177212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:43.178847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:43.247490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 728/1466] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:43.390091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:43.390091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:43.390091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:43.472220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:43.478203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:43.504420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 739/1467] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Oct 14 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:43.526339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:43.533924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:43.562290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:43.564013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:43.569581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7714-d504-4aaf-91a7-6b5bf5f5162f service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:43.575678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:43.576568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:43.576945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:43.577349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] PATH_INFO: `/v3/projects/2336e42698d14a079ee6e68584e47ec0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:43.578917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2336e42698d14a079ee6e68584e47ec0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:43.582466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:43.597576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d392-7932-4710-8ab7-a277155a595a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:43.611684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:43.615164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:43.616738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:43.617214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:43.645040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:43.648854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ed890-ad07-4989-9420-0d079c4da263 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:43.689598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 740/1468] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:43.754599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2336e42698d14a079ee6e68584e47ec0', 'request_id': 'req-8edfee0c-eac5-44c5-ae17-85876a6cdf48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:43.769424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2336e42698d14a079ee6e68584e47ec0', 'request_id': 'req-8edfee0c-eac5-44c5-ae17-85876a6cdf48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:43.791334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2336e42698d14a079ee6e68584e47ec0', 'request_id': 'req-8edfee0c-eac5-44c5-ae17-85876a6cdf48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:43.843335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] The token cache is being invalidate because project 2336e42698d14a079ee6e68584e47ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:43.852846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:43.856550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8edfee0c-eac5-44c5-ae17-85876a6cdf48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:43.861001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 729/1469] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:43 2022] DELETE /identity/v3/projects/2336e42698d14a079ee6e68584e47ec0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:43.866435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:43.866831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:43.867232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:43.934069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:43.939629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:44.098215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 741/1470] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:44.106408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.106827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.107573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.152703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:44.155006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:44.190914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 730/1471] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:44.192231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.204589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effd93-945d-4846-a310-e95a8ad2b064 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.228352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.229094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.229622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.229973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.230920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:44.231071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.233032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.268781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.275442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 742/1472] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:44.279824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29b4a2-f822-4be3-bbde-b4132c9006d2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.301163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.302176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.302668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.303136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.304096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.306252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.382212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 731/1473] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:44 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:44.386191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.396972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2fb4-5bf7-4157-9d4b-e5aaef36412f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.554835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.562293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.563887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.563887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.572811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.581198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.662868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 743/1474] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:44 2022] POST /identity/v3/users => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:55:44.666925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.685150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1fc5e-4127-41b6-9964-3672acf183b9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.696640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.697539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.698653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.699164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.700081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.702070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.743041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 732/1475] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:44.747034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.763806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81ecf-cd31-439b-80fe-e2dbcf596b39 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.779622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.780639 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.781128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.781623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.783209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.785055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1382c03-b0c0-4bc8-85b1-cae92b9efa1f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.823258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 744/1476] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:44.827584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:44.835616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:44.848582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fe16a-5208-4bc2-944e-e27d186e4f93 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:44.857514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:44.858995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.859519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.860101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] PATH_INFO: `/v3/projects/42b99dc4973b4c68b3d18abdc25d409d/users/afa2bd21687c426087bd1e7d1c9f151d/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:44.894524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b99dc4973b4c68b3d18abdc25d409d, user_id=afa2bd21687c426087bd1e7d1c9f151d, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:44.898523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:44.930889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 733/1477] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:44 2022] PUT /identity/v3/projects/42b99dc4973b4c68b3d18abdc25d409d/users/afa2bd21687c426087bd1e7d1c9f151d/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:44.935529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:44.936102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:44.936780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:45.046489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] MFA Rules not processed for user `afa2bd21687c426087bd1e7d1c9f151d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:45.049997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:45.123568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:45.209069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 745/1478] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:45.212324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:45.454979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cbe92-8c45-4018-8f6a-56a0ffef5103 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:45.502618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:45.509242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:45.510387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:45.513032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:45.514450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:45.526026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:45.566425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:45.568066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:45.595408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393fe2e-8ec7-4ebd-b54e-20d49a20b671 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:45.607859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:45.608578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:45.609051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:45.609363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] PATH_INFO: `/v3/users/b50f32ad809746568505281866815dd9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:45.612757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50f32ad809746568505281866815dd9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:45.614865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:45.669159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 734/1479] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:45 2022] POST /identity/v3/projects => generated 401 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:45.673350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:45.838692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50f32ad809746568505281866815dd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:45.842661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50f32ad809746568505281866815dd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:45.885589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50f32ad809746568505281866815dd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:45.888983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50f32ad809746568505281866815dd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:45.914665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50f32ad809746568505281866815dd9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:45.927867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b430da-cdbc-44fe-9244-4abf25e6d852 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:45.940938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:45.941726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:45.942060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:45.942401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:45.943051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:45.949078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16424c-3fbc-4b41-b571-2361bd498900 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:45.988662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 746/1480] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:45 2022] DELETE /identity/v3/users/b50f32ad809746568505281866815dd9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:45.992782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:45.997350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.006331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 735/1481] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:45 2022] POST /identity/v3/users => generated 307 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:46.007875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:46.008085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:46.008356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:46.060656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:46.061957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.200692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:46.241497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 736/1482] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:46.242502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:46.243945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.277724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faca6b4-4cde-4312-85d6-cef24cf2fee4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:46.289258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf5793-185c-4c61-9300-f648eb2c83cb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:46.308780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:46.310354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:46.311014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:46.311389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:46.311626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:46.312273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:46.312762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:46.315162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:46.315735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] PATH_INFO: `/v3/projects/d120e229ac834915b049d110cb2160ca` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:46.322960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:46.331713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d120e229ac834915b049d110cb2160ca)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:46.335962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:46.375319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 737/1483] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:46.376640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:46.391059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.471149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd120e229ac834915b049d110cb2160ca', 'request_id': 'req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:46.479781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:46.496497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd120e229ac834915b049d110cb2160ca', 'request_id': 'req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:46.517770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd120e229ac834915b049d110cb2160ca', 'request_id': 'req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:46.559448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] The token cache is being invalidate because project d120e229ac834915b049d110cb2160ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:46.563606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:46.571417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:46.575531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 747/1484] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:45 2022] DELETE /identity/v3/projects/d120e229ac834915b049d110cb2160ca => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:46.577013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:46.579824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.599565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31560397-a265-42bb-910a-3a543cbf6d14 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:46.761903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:46.762704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:46.763340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f95ce-d1a0-4ef6-bd65-0312ccc2111c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:46.764788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:46.765216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:46.770814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.788737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:46.789432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:46.789715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:46.789987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] PATH_INFO: `/v3/projects/06994f94bc9442ac9101350eab3b2df5/users/9869b803936f466e967fbf70f2d52df0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:46.820996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:46.823824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:46.845047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06994f94bc9442ac9101350eab3b2df5, user_id=9869b803936f466e967fbf70f2d52df0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:46.853182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:46.861741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 738/1485] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:46.862836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:46.880466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:46.905059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 748/1486] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:46 2022] PUT /identity/v3/projects/06994f94bc9442ac9101350eab3b2df5/users/9869b803936f466e967fbf70f2d52df0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:46.905241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4ed8e-783d-4762-9cb5-098196ccf42e service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:46.907531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:47.092113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ff06-6eb5-4b76-92bc-594bda899082 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:47.103070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:47.103691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.103972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.104243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] PATH_INFO: `/v3/users/2e065fc1aa854793ac0aff224fc128b5` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.105434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e065fc1aa854793ac0aff224fc128b5)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:47.115591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:47.120148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:47.120773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.121225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.121524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.122152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:47.124125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:47.170421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 749/1487] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:47.171816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:47.240622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21f23-e52e-443f-8a1a-b914b60e60a1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:47.255764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:47.257858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e065fc1aa854793ac0aff224fc128b5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:47.259150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e065fc1aa854793ac0aff224fc128b5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:47.268459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:47.269148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.269430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.269705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] PATH_INFO: `/v3/projects/06994f94bc9442ac9101350eab3b2df5/users/9869b803936f466e967fbf70f2d52df0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.274886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e065fc1aa854793ac0aff224fc128b5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:47.278473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06994f94bc9442ac9101350eab3b2df5, user_id=9869b803936f466e967fbf70f2d52df0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:47.284834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042120af-9a4a-47c0-919a-3bffbd8bc102 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:47.295230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e065fc1aa854793ac0aff224fc128b5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:47.319826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 750/1488] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:47 2022] PUT /identity/v3/projects/06994f94bc9442ac9101350eab3b2df5/users/9869b803936f466e967fbf70f2d52df0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:47.332373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e065fc1aa854793ac0aff224fc128b5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:47.333309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271534-f7c0-4635-9ed9-7796e01211e8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.333604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271534-f7c0-4635-9ed9-7796e01211e8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.334550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271534-f7c0-4635-9ed9-7796e01211e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.413298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 739/1489] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:46 2022] DELETE /identity/v3/users/2e065fc1aa854793ac0aff224fc128b5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:47.433573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-72271534-f7c0-4635-9ed9-7796e01211e8 None None] MFA Rules not processed for user `9869b803936f466e967fbf70f2d52df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:47.434858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-72271534-f7c0-4635-9ed9-7796e01211e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:47.522340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:47.580224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 751/1490] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:47.592781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:47.595144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:47.711391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fd6a-d1c9-4c33-9c75-2136e0922e9f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:47.719098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:47.721501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.722078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.722354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.746670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:47.749115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5ee55-196e-4094-93e7-16484c4a5475 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:47.787769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 740/1491] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:47.860972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac8019-937b-4e48-b5e2-6b5409d673bd None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.862073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac8019-937b-4e48-b5e2-6b5409d673bd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.862507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac8019-937b-4e48-b5e2-6b5409d673bd None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.864402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 752/1492] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:55:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:47.891692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.896090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.896487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.914391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac8019-937b-4e48-b5e2-6b5409d673bd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:47.931972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac8019-937b-4e48-b5e2-6b5409d673bd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:47.943230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:47.944140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:47.944600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:47.945149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:47.948707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:47.956736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:47.957997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:48.105157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:48.106770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:48.164465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 753/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:48.208808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 741/1494] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:55:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:49.491655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:49.494947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:49.530100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc50c51-4b3e-4936-9c1f-449a38a093ca service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:49.548814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:49.550467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:49.550892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:49.551388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:49.580768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:49.582882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:49.620272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 754/1495] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:49.820265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:49.826479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:49.989717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:49.991535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:50.072459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:50.090909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc4ede-4236-4c35-bf7b-1307cb07cbdc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:50.116057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:50.118745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.120292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.120769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] PATH_INFO: `/v3/projects/58938e76fa104a8f83b14717c67ca068` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.125778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58938e76fa104a8f83b14717c67ca068)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:50.133690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:50.273468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875712-0b26-4160-b092-3f15fca5f16b service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:50.300264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58938e76fa104a8f83b14717c67ca068', 'request_id': 'req-48d948a7-e367-4459-9191-cb6b846c570c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.317324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58938e76fa104a8f83b14717c67ca068', 'request_id': 'req-48d948a7-e367-4459-9191-cb6b846c570c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.361617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58938e76fa104a8f83b14717c67ca068', 'request_id': 'req-48d948a7-e367-4459-9191-cb6b846c570c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.404091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] The token cache is being invalidate because project 58938e76fa104a8f83b14717c67ca068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:50.404556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.405790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.416942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 742/1496] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:49 2022] DELETE /identity/v3/projects/58938e76fa104a8f83b14717c67ca068 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:50.421223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:50.423616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:50.436191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:50.437574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.438471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.438995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] PATH_INFO: `/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.440705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f91ebaff4de46328b7cc12a8313c6e3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:50.444280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:50.449363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:50.614148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f91ebaff4de46328b7cc12a8313c6e3', 'request_id': 'req-717183bd-1b3b-4587-8628-4cb967c28c17'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.632909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f91ebaff4de46328b7cc12a8313c6e3', 'request_id': 'req-717183bd-1b3b-4587-8628-4cb967c28c17'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.642302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f91ebaff4de46328b7cc12a8313c6e3', 'request_id': 'req-717183bd-1b3b-4587-8628-4cb967c28c17'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.669827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d948a7-e367-4459-9191-cb6b846c570c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:50.670443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] The token cache is being invalidate because project 7f91ebaff4de46328b7cc12a8313c6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:50.672036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.673603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-717183bd-1b3b-4587-8628-4cb967c28c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:50.685733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 755/1497] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:49 2022] DELETE /identity/v3/projects/7f91ebaff4de46328b7cc12a8313c6e3 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:50.688247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464c46-ca99-4430-9cc5-dd20b90cf5cb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.688739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464c46-ca99-4430-9cc5-dd20b90cf5cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.689022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0464c46-ca99-4430-9cc5-dd20b90cf5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.744659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b0464c46-ca99-4430-9cc5-dd20b90cf5cb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:50.745929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0464c46-ca99-4430-9cc5-dd20b90cf5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:50.843150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:50.847348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.848170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.848728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] PATH_INFO: `/v3/users/11c887fc5c994b13a1df7284ab70f7cc` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.864122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c887fc5c994b13a1df7284ab70f7cc)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:50.868515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:50.905969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 756/1498] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:50.914507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910900d5-1f62-49a2-979b-91f6c5f17959 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.915532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910900d5-1f62-49a2-979b-91f6c5f17959 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.915532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910900d5-1f62-49a2-979b-91f6c5f17959 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.919595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 757/1499] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:55:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:50.920979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363954-9c66-400d-823b-414337655e08 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:50.921294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363954-9c66-400d-823b-414337655e08 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:50.921841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363954-9c66-400d-823b-414337655e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:50.969518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e6363954-9c66-400d-823b-414337655e08 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:50.970909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6363954-9c66-400d-823b-414337655e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:51.006280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 758/1500] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:51.007135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363954-9c66-400d-823b-414337655e08 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.034274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363954-9c66-400d-823b-414337655e08 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.048024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.048896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.049198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.049479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.050159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:51.050486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.056031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426489a-ec81-427e-890e-22e911e16296 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.071822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:51.085410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 759/1501] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:51.090970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.091260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.091634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.105679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c887fc5c994b13a1df7284ab70f7cc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:51.107137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c887fc5c994b13a1df7284ab70f7cc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:51.130350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c887fc5c994b13a1df7284ab70f7cc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:51.131539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c887fc5c994b13a1df7284ab70f7cc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:51.147361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c887fc5c994b13a1df7284ab70f7cc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:51.149500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:51.151003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:51.205378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 743/1502] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:50 2022] DELETE /identity/v3/users/11c887fc5c994b13a1df7284ab70f7cc => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:51.206854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.209669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:51.386697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8d50-2897-4bbe-86e2-e02c16717c65 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.395523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 760/1503] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:51.418520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.418839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.419724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.420064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.421367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.433701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.480372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 744/1504] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:51 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:51.490061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.501191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:51.508051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fcd8-e1fb-42b8-b58f-4c206faa0d6e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.622975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.623994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.624344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.624829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.626995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.630326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.716333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 761/1505] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:51 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:51.724593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.737997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.741103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45572dc-a90b-4143-9e2e-8bc649863e95 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.743704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:51.754232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.755128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.755128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.755528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.767856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.767856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.782619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 745/1506] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:51.789312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.815312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d67f-284f-4276-a1e4-c56b982b1d0a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.830461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.832126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.833322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.833603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.835032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.838874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.858832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 746/1507] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:51.863995 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:51.880010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d54a-6666-48f8-a558-dc0a5528bdf7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.887298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:51.887841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.888197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.888535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] PATH_INFO: `/v3/projects/2f297f9a6b4548f18d51f9580925ee0e/users/2c5d59e2038f40b985e55ecd4d1345f9/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:51.909223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f297f9a6b4548f18d51f9580925ee0e, user_id=2c5d59e2038f40b985e55ecd4d1345f9, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:51.913343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d07c0-003c-4a1f-8fda-e016100fc597 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:51.937095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc4b9-25fc-4693-a24f-a1e6fcfc540e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:51.965247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 747/1508] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:51 2022] PUT /identity/v3/projects/2f297f9a6b4548f18d51f9580925ee0e/users/2c5d59e2038f40b985e55ecd4d1345f9/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:51.972258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:51.972754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:51.973092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.032768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] MFA Rules not processed for user `2c5d59e2038f40b985e55ecd4d1345f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:52.034338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.112757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:52.127418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.128215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.128418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.128691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.154806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.156964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.177346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 762/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:52.179382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.181340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.187157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 748/1510] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:52.202698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.206349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.213667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:52.355044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0f70a-7200-42cd-a777-2a39213c3fe5 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.364470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d762-3fe2-40c2-8c3f-0102e6d18850 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.366809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.367576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.368776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.369655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] PATH_INFO: `/v3/users/a9f713322018467caaa21de14988839c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.371396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f713322018467caaa21de14988839c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.375548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.378261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.378962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.379445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.379724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.408741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.410523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.426258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 749/1511] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:52.427364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.436387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.467670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e59a7-8884-49c9-8bf4-674c5b718198 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.472243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f713322018467caaa21de14988839c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.473276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f713322018467caaa21de14988839c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.480977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.481427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.481717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.481993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] PATH_INFO: `/v3/projects/22665380e49649bf8aadd03fecc019b9` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.482179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f713322018467caaa21de14988839c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.482882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f713322018467caaa21de14988839c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.484405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22665380e49649bf8aadd03fecc019b9)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.492358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.501429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-162e31df-b310-415a-a040-d8caf3c614ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f713322018467caaa21de14988839c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.535606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 763/1512] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:52 2022] DELETE /identity/v3/users/a9f713322018467caaa21de14988839c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:52.541136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.541505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.541847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.569429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:52.570810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.597218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22665380e49649bf8aadd03fecc019b9', 'request_id': 'req-b9a30d72-6e13-40fe-80b3-9481ffdc5910'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.606257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22665380e49649bf8aadd03fecc019b9', 'request_id': 'req-b9a30d72-6e13-40fe-80b3-9481ffdc5910'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.615667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22665380e49649bf8aadd03fecc019b9', 'request_id': 'req-b9a30d72-6e13-40fe-80b3-9481ffdc5910'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.628010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] The token cache is being invalidate because project 22665380e49649bf8aadd03fecc019b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:52.628321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.629130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b9a30d72-6e13-40fe-80b3-9481ffdc5910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:52.631224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 750/1513] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:52 2022] DELETE /identity/v3/projects/22665380e49649bf8aadd03fecc019b9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:52.636123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3354-5102-4955-9bac-9140a4a1befc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.636430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3354-5102-4955-9bac-9140a4a1befc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.636687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3354-5102-4955-9bac-9140a4a1befc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.659325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 764/1514] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:52.668792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.669470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b3dc3354-5102-4955-9bac-9140a4a1befc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:52.670467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.670593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3dc3354-5102-4955-9bac-9140a4a1befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.723858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:52.752769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f16ec-906d-42bc-a694-37185e4cd571 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.758417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 751/1515] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:52.767890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.768284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.768634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.821432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:52.822940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:52.843779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 752/1516] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:52.847758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.853114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:52.858143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.858782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.859057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.859383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.861445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b708f7-f697-4c91-9917-74ef83d193f9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.873894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.874902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.876083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.876887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.880853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.881239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.882012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:52.882414 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.886301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.887927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 765/1517] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:52.912625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 753/1518] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:52.913564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:52.925461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e27e2-cfc9-401d-869e-11e281cfadc0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:52.939133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:52.940010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:52.940457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:52.940899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:52.941693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:52.943800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:52.992823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 766/1519] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:52 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:52.996865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.008525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d273-b34d-4c0f-b20f-31baa90f1cc9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.073163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.073884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.074257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.074624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.075396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.077408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.102542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 754/1520] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:52 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:53.104121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.120147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6208a4-3c04-4c13-96b2-d24d60549441 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.126300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.127388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.127918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.128334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.129311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.131417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.146586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 767/1521] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:53.149072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.162185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123df6c-e977-4c2b-87d9-e33de805a304 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.167944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.168524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.169912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.170800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.171471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.173290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2150-04c0-4c45-828c-0e5a6029160c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.184502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 755/1522] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:53.188542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.199357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3a11-c7b2-4332-9001-99c003048438 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.206757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.207551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.207899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.208278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] PATH_INFO: `/v3/projects/4ea9b9fc6d104295a4def65f45ba520f/users/bfa23ccbb8c74518a443c6df121f00f7/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.224131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea9b9fc6d104295a4def65f45ba520f, user_id=bfa23ccbb8c74518a443c6df121f00f7, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.227368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.241223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 768/1523] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:53 2022] PUT /identity/v3/projects/4ea9b9fc6d104295a4def65f45ba520f/users/bfa23ccbb8c74518a443c6df121f00f7/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:53.251816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.252176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.252511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.283117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] MFA Rules not processed for user `bfa23ccbb8c74518a443c6df121f00f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:53.284362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.348884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.348884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.382728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 756/1524] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:53.388111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.457889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1ec85-39f6-4cca-b601-417646adf999 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.465368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.466354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.467078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.467200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] PATH_INFO: `/v3/projects/08900ca210d3421abe9cba44f1f4d6d3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.469856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08900ca210d3421abe9cba44f1f4d6d3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.472613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.521426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:53.530217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32464ed-bd2e-4c45-ad0a-b2c889438dbd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.554966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:53.572688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08900ca210d3421abe9cba44f1f4d6d3', 'request_id': 'req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.588606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08900ca210d3421abe9cba44f1f4d6d3', 'request_id': 'req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.597691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08900ca210d3421abe9cba44f1f4d6d3', 'request_id': 'req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.611533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] The token cache is being invalidate because project 08900ca210d3421abe9cba44f1f4d6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:53.612280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.613177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.616174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 769/1525] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:53 2022] DELETE /identity/v3/projects/08900ca210d3421abe9cba44f1f4d6d3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:53.619445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.620966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.623654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.624279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.624558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.624830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.625500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.628454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.651009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f680c-a8fc-4fc5-9133-6fb2fc8a591b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.659975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.660630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.660908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.661201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] PATH_INFO: `/v3/users/4893a2ef8f6a471dac45afe890910400` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.662374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4893a2ef8f6a471dac45afe890910400)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.664340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.669304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 757/1526] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:53 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:53.669304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.671256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.735799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4893a2ef8f6a471dac45afe890910400'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.736636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4893a2ef8f6a471dac45afe890910400'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.740952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6f869-8f68-47b3-846e-71bfac71aab7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.745897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4893a2ef8f6a471dac45afe890910400'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.746068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.746723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.746838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4893a2ef8f6a471dac45afe890910400'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.747125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.747492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] PATH_INFO: `/v3/users/afa2bd21687c426087bd1e7d1c9f151d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.748749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa2bd21687c426087bd1e7d1c9f151d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.751504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:53.758034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4893a2ef8f6a471dac45afe890910400'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.779569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 770/1527] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:53 2022] DELETE /identity/v3/users/4893a2ef8f6a471dac45afe890910400 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:53.784300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:53.785811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.814057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa2bd21687c426087bd1e7d1c9f151d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.815138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa2bd21687c426087bd1e7d1c9f151d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.824468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa2bd21687c426087bd1e7d1c9f151d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.825365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa2bd21687c426087bd1e7d1c9f151d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.837072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e4e7c613-e808-43d2-a02e-832c391bd21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa2bd21687c426087bd1e7d1c9f151d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:53.871371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 758/1528] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:53 2022] DELETE /identity/v3/users/afa2bd21687c426087bd1e7d1c9f151d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:53.872536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbc039-ec1e-4b58-a667-f9010e79f92b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:53.875852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.877707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.878125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.908617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:53.910260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:53.917993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:53.952039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:53.971210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:53.972193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:53.972651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:53.972991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:53.973730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:53.976156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.016466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 771/1529] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:53 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:54.017482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.019571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:54.030132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 759/1530] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:54.042046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42bb3-162c-4ecf-8131-c2b8db9b7b65 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.050787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.050992 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.051466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.051735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.052012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.052578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:54.052708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.054428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.081583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 772/1531] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:54.082679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.111125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4026bd-b537-4942-af3c-ba2027f99b4e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.121693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.122363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.122636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.122905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] PATH_INFO: `/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff/users/f9994a1315a04fea939932aadd1d778c/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.157844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1a26-b84e-4106-9ffe-a9aa76260266 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.160153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04d9f9753da47baa77d2a3a7b92d8ff, user_id=f9994a1315a04fea939932aadd1d778c, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.164559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.168533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.169163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.169538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.169802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.196051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.201458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 773/1532] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:54 2022] PUT /identity/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff/users/f9994a1315a04fea939932aadd1d778c/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:54.202455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.205186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.230772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 760/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:54.316989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119833a-9760-4cf8-aa03-700155ff7a97 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.325691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.326263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.326427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.327755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.329579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.332080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc56a-dcc6-4b80-8fad-1b1516dd8885 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.351311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 774/1534] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:54.354134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.369604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd4abe-a2a6-4a56-a20d-2e1a5ed1960f service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.374289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.374954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.375934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.376938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] PATH_INFO: `/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff/users/f9994a1315a04fea939932aadd1d778c/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.379067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04d9f9753da47baa77d2a3a7b92d8ff, user_id=f9994a1315a04fea939932aadd1d778c, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.382433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.406573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 761/1535] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:54 2022] PUT /identity/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff/users/f9994a1315a04fea939932aadd1d778c/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:54.407750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.408018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.408348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.440607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] MFA Rules not processed for user `f9994a1315a04fea939932aadd1d778c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:54.441794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:54.551435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 775/1536] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:54.568613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.571439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:54.619756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:54.621226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:54.669214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:54.704444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a93f0-f048-483f-954a-53b7e0ab3f16 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.722493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.723137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.726457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.726926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.772681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.778149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806648e8-81e5-4876-9dd5-6a84009c914a service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.788615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790133-3aab-484e-9b4b-e74a2b3b1820 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:54.794082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:54.794806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.795198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.795563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] PATH_INFO: `/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.797455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ae29b7a3fd40ea92ea37d0861f19f8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:54.799739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:54.823691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 762/1537] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:54.883197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ae29b7a3fd40ea92ea37d0861f19f8', 'request_id': 'req-8a767ce5-6efa-409a-89f0-e7fe849729a4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:54.898133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ae29b7a3fd40ea92ea37d0861f19f8', 'request_id': 'req-8a767ce5-6efa-409a-89f0-e7fe849729a4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:54.918346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ae29b7a3fd40ea92ea37d0861f19f8', 'request_id': 'req-8a767ce5-6efa-409a-89f0-e7fe849729a4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:54.933211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] The token cache is being invalidate because project 09ae29b7a3fd40ea92ea37d0861f19f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:54.934043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:54.934333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8a767ce5-6efa-409a-89f0-e7fe849729a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:54.937293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 776/1538] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:54 2022] DELETE /identity/v3/projects/09ae29b7a3fd40ea92ea37d0861f19f8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:54.942563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:54.943120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:54.943120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:54.990190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:54.991598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.072410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:55.126065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 763/1539] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:55.128833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.129376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.129721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.163619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:55.164818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.181469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 777/1540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:55.183021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.197091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9c36-246a-4e7a-b3bf-631b7b56ebb8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.209437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.210331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.210755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.211117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.211868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:55.212231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.214095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.231333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 764/1541] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:55.236196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.248876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307058fb-e747-4fbd-a38b-52b14ee8357d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.257097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.257854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.258223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.258642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.260636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.262834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.284906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.286675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.309546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4683-ca16-44aa-b7f8-c0a5c16b673c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.317729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 778/1542] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:55 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:55:55.322972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.323661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.323938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.324206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] PATH_INFO: `/v3/projects/42b99dc4973b4c68b3d18abdc25d409d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.325220 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.326192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b99dc4973b4c68b3d18abdc25d409d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.328490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.420342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cff55-aae9-4f19-9df5-2d80ffc56a03 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.450698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b99dc4973b4c68b3d18abdc25d409d', 'request_id': 'req-366133ba-eb66-47b9-9747-e7723a7d788e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.459212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b99dc4973b4c68b3d18abdc25d409d', 'request_id': 'req-366133ba-eb66-47b9-9747-e7723a7d788e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.464852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:55.470716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b99dc4973b4c68b3d18abdc25d409d', 'request_id': 'req-366133ba-eb66-47b9-9747-e7723a7d788e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.489935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] The token cache is being invalidate because project 42b99dc4973b4c68b3d18abdc25d409d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:55.490476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.492280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.494806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 765/1543] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:55 2022] DELETE /identity/v3/projects/42b99dc4973b4c68b3d18abdc25d409d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:55.496189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.497713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.510995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.512007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.512348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.512685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.513401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.515455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.548871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 779/1544] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:55 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:55.550485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.554320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.570391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43881-3981-4d71-b560-bd2ec25d9c4c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.590121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.590881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.591239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.591661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] PATH_INFO: `/v3/users/9869b803936f466e967fbf70f2d52df0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.593103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9869b803936f466e967fbf70f2d52df0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.597266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.619709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366133ba-eb66-47b9-9747-e7723a7d788e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.632144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.632821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.633141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.633436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] PATH_INFO: `/v3/users/bfa23ccbb8c74518a443c6df121f00f7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.634744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa23ccbb8c74518a443c6df121f00f7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.637156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.660975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9869b803936f466e967fbf70f2d52df0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.661706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9869b803936f466e967fbf70f2d52df0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.671396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9869b803936f466e967fbf70f2d52df0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.672351 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9869b803936f466e967fbf70f2d52df0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.688372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9869b803936f466e967fbf70f2d52df0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.700877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa23ccbb8c74518a443c6df121f00f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.701623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa23ccbb8c74518a443c6df121f00f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.709340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:55.710290 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 780/1545] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:55 2022] DELETE /identity/v3/users/9869b803936f466e967fbf70f2d52df0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:55.711516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.712820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa23ccbb8c74518a443c6df121f00f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.712931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.714348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa23ccbb8c74518a443c6df121f00f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.733490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f94bd028-2f11-4c69-b039-2f3546deb5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa23ccbb8c74518a443c6df121f00f7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:55.766580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 766/1546] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:55 2022] DELETE /identity/v3/users/bfa23ccbb8c74518a443c6df121f00f7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:55.774671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.778423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.778881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.826860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:55.832487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.872588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea920-ecb0-4b8d-8410-1d49270ec227 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:55.927353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 767/1547] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:55.928581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:55.940647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.942988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:55.962200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:55.963133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:55.963656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:55.964130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:55.965120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:55.967664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:55.985630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 781/1548] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:55.989582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:55.991789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.006679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e4aeb-fdb1-412a-9a32-18563458607d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.011204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523e430-f5af-4837-8b28-4d72a772bf5c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.012954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.013687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.013972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.014248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.015041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.015871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.016583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.016925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.017263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.017368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.027513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.029297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5321-314d-4571-a21c-2dc25b7dfcc2 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.032697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 782/1549] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:55:56.033741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.044624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a8ad-0778-414f-ab24-b5e40f27b505 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.051083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.051793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.052285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.052605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] PATH_INFO: `/v3/projects/5ce303a962a64c929bef29861a13d747/users/669f4762181243639810deab7148c94a/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.075605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 768/1550] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:56.109945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce303a962a64c929bef29861a13d747, user_id=669f4762181243639810deab7148c94a, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.112677 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.135267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 783/1551] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:56 2022] PUT /identity/v3/projects/5ce303a962a64c929bef29861a13d747/users/669f4762181243639810deab7148c94a/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:56.146951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.147566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.147942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.181614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] MFA Rules not processed for user `669f4762181243639810deab7148c94a`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:56.183021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.232510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.234729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.300207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 769/1552] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:56.304589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.314188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:56.340433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf0fb-5b7d-4702-a785-adee6d791789 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.346752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.347325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.347636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.347961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] PATH_INFO: `/v3/projects/06994f94bc9442ac9101350eab3b2df5` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.350691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06994f94bc9442ac9101350eab3b2df5)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.353616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.439841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4783-bbd5-4c08-83f0-5bac175c3bbc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.465794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06994f94bc9442ac9101350eab3b2df5', 'request_id': 'req-9b85a56a-4be2-4948-bf0f-ab37b438d20a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:56.484055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06994f94bc9442ac9101350eab3b2df5', 'request_id': 'req-9b85a56a-4be2-4948-bf0f-ab37b438d20a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:56.498870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06994f94bc9442ac9101350eab3b2df5', 'request_id': 'req-9b85a56a-4be2-4948-bf0f-ab37b438d20a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:56.517359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] The token cache is being invalidate because project 06994f94bc9442ac9101350eab3b2df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:56.517703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:56.518498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9b85a56a-4be2-4948-bf0f-ab37b438d20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:56.520432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 784/1553] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:56 2022] DELETE /identity/v3/projects/06994f94bc9442ac9101350eab3b2df5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:55:56.526015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f172d-00c6-41d9-a08e-438e26d12e7c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.526321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f172d-00c6-41d9-a08e-438e26d12e7c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.526585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f172d-00c6-41d9-a08e-438e26d12e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.533382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.534444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.535015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.535588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.536429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.538781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.550941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8b3f172d-00c6-41d9-a08e-438e26d12e7c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:56.552651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8b3f172d-00c6-41d9-a08e-438e26d12e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.571393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 785/1554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:56.573650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.574112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.574519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.599736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:56.601037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.616666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 786/1555] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:56.619628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.624601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 770/1556] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:56.630552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.632968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.652354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fab4c-b8a6-4e0a-a671-07deb9b1debe None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.754202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:56.813351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81492e-de2e-45a7-90b2-213670e2643b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.825967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.826601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.826879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.827335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.828351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.830161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.868373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.869869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.870749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.871226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.873368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:56.873828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.878170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.884731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 771/1557] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:56.887252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.890427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:56.904768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 787/1558] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:55:56.907531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.924252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6481b2-1713-47cc-8cc5-2eb1812dba47 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.940768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.941397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.941679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.941966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.942593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.944752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a269-bc31-4746-984a-ac160d92619b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.945382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.953152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.954276 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.954560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.954830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] PATH_INFO: `/v3/projects/4ea9b9fc6d104295a4def65f45ba520f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:56.956277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea9b9fc6d104295a4def65f45ba520f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:56.958227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:56.967733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 788/1559] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:56.969539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:56.986621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6138c-a00a-4de5-b02d-f8c453acafb7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:56.989184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:56.994889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:56.996447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:56.996933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:56.997675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.000534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.005647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.026120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea9b9fc6d104295a4def65f45ba520f', 'request_id': 'req-5d305667-49fe-4eca-bd87-dedb0d06aac1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.037169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea9b9fc6d104295a4def65f45ba520f', 'request_id': 'req-5d305667-49fe-4eca-bd87-dedb0d06aac1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.046680 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea9b9fc6d104295a4def65f45ba520f', 'request_id': 'req-5d305667-49fe-4eca-bd87-dedb0d06aac1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.054083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 789/1560] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:56 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:57.055020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.063197 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] The token cache is being invalidate because project 4ea9b9fc6d104295a4def65f45ba520f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:57.064029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.064866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.066680 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 772/1561] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:56 2022] DELETE /identity/v3/projects/4ea9b9fc6d104295a4def65f45ba520f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:57.067261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.068691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.133466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd8be-9b73-4b5f-8a67-f1d0aeb8bc86 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.138617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.139638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.139924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.140880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] PATH_INFO: `/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f/users/3f2344d464d54bc7b45d750ed2d318f0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.164112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf55c3bfed74c5d9d4f9abe7d4d5a7f, user_id=3f2344d464d54bc7b45d750ed2d318f0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.167602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.184643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305667-49fe-4eca-bd87-dedb0d06aac1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.195204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 790/1562] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:57 2022] PUT /identity/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f/users/3f2344d464d54bc7b45d750ed2d318f0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:57.196102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.198603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.284061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5894e2-b3c2-474e-ae78-a0416bf331f2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.289047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.289698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.290216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.290350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.291150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.291226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.294130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.294547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.295228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] PATH_INFO: `/v3/users/f9994a1315a04fea939932aadd1d778c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.295363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.296288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9994a1315a04fea939932aadd1d778c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.298892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.311920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:57.325020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 773/1563] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:57 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:57.325020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.325020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.337427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb31ad-c4aa-4dab-992b-d4ee5b285f55 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.342892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.344696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.345210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.345462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.346868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.348709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.366639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 774/1564] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:57.366639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.376781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0b8e-f351-4dd3-b9d4-6f6943a691f4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.378112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9994a1315a04fea939932aadd1d778c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.378789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9994a1315a04fea939932aadd1d778c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.382252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.383135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.383452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.383729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.384368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.386238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.387526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9994a1315a04fea939932aadd1d778c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.388226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9994a1315a04fea939932aadd1d778c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.397534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9994a1315a04fea939932aadd1d778c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:57.399906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 775/1565] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:57.400917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.402790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.422891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 791/1566] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:57 2022] DELETE /identity/v3/users/f9994a1315a04fea939932aadd1d778c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:57.423073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213640e-d59e-4f0a-8cb7-e57487caf852 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.423175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.423175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.462826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:57.562962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.564072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.564173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.564453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] PATH_INFO: `/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f/users/3f2344d464d54bc7b45d750ed2d318f0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.565805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeecd04-8998-4eae-9b74-8ddc15f87872 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.570892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf55c3bfed74c5d9d4f9abe7d4d5a7f, user_id=3f2344d464d54bc7b45d750ed2d318f0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.573247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.573876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f439f-8477-4ba0-b5ed-1e8d7cb1b7f3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.574566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.575733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.576216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.577334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.580464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.601159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 792/1567] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:57.605719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.612850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 776/1568] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:57 2022] PUT /identity/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f/users/3f2344d464d54bc7b45d750ed2d318f0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:57.616101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.616489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.616765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.638820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473aa88-14b1-4d74-80c6-9024a5bcfe32 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:57.654687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] MFA Rules not processed for user `3f2344d464d54bc7b45d750ed2d318f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:57.656807 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.795211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:57.799955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.800271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.800551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] PATH_INFO: `/v3/projects/62acc9c6b23e40bdab34361355993100/users/9ee7bf74d8a24e3d902424303fa5823a/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.828530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 777/1569] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:57.841163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62acc9c6b23e40bdab34361355993100, user_id=9ee7bf74d8a24e3d902424303fa5823a, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:57.843151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:57.847376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.850281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e767c-15db-42ed-a84f-89bb150f8098 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:57.880669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 793/1570] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:57 2022] PUT /identity/v3/projects/62acc9c6b23e40bdab34361355993100/users/9ee7bf74d8a24e3d902424303fa5823a/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:57.890065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:57.890630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:57.891643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:57.909013 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:57.959138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] MFA Rules not processed for user `9ee7bf74d8a24e3d902424303fa5823a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:57.962994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:57.978370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad8224-458f-478e-945e-e14a57b6ecf0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.068083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.069383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.069763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.070691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.086234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:58.090288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 794/1571] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:55:58.096335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.172431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.174582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.188722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 778/1572] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:58.200177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.202152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.247056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c710-dca7-4ee1-99a6-1b70c41ca1a0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.254560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703208-721d-4622-838e-40bca701c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.255635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703208-721d-4622-838e-40bca701c2af admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.256051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703208-721d-4622-838e-40bca701c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.256457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703208-721d-4622-838e-40bca701c2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.257294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703208-721d-4622-838e-40bca701c2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.259843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703208-721d-4622-838e-40bca701c2af admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.323108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 795/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:58 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:58.324403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703208-721d-4622-838e-40bca701c2af admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.411239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703208-721d-4622-838e-40bca701c2af admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.416720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.417475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.417823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.418166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] PATH_INFO: `/v3/users/669f4762181243639810deab7148c94a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.419528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=669f4762181243639810deab7148c94a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.432496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.455707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156dd8-b0c7-409e-80d5-cb3d6e81619b service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.465476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:58.467776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.468456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.470605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.471776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] PATH_INFO: `/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.473302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04d9f9753da47baa77d2a3a7b92d8ff)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.475704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.521613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669f4762181243639810deab7148c94a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.523015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669f4762181243639810deab7148c94a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.543757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669f4762181243639810deab7148c94a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.545310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669f4762181243639810deab7148c94a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.565760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669f4762181243639810deab7148c94a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.569214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04d9f9753da47baa77d2a3a7b92d8ff', 'request_id': 'req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.586250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04d9f9753da47baa77d2a3a7b92d8ff', 'request_id': 'req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.603422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 796/1574] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:55:58 2022] DELETE /identity/v3/users/669f4762181243639810deab7148c94a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:58.608342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.608831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04d9f9753da47baa77d2a3a7b92d8ff', 'request_id': 'req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.612602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.637933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] The token cache is being invalidate because project b04d9f9753da47baa77d2a3a7b92d8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:58.638222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.638898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d80b43de-1a7e-4b36-8dc5-4a3e626349dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:58.640451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 779/1575] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:58 2022] DELETE /identity/v3/projects/b04d9f9753da47baa77d2a3a7b92d8ff => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:58.647865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcea54-780c-4895-bea8-4e05968fa978 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.648861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcea54-780c-4895-bea8-4e05968fa978 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.648861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcea54-780c-4895-bea8-4e05968fa978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.700764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0bfcea54-780c-4895-bea8-4e05968fa978 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:58.704172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0bfcea54-780c-4895-bea8-4e05968fa978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.727472 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff584f-8152-4d14-b89b-eb881f820d2c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.736372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.737847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.738187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.738514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.739503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.741977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a29cc-481d-498f-9506-ac4aee71e9e1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.759813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:58.793913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 797/1576] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:58 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:58.798445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.799044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.799044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.822844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:58.824923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.841156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 798/1577] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:58.841156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.841156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.852806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf33b6-53c8-4143-b321-679f9e4610a0 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:58.857022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 780/1578] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:58.858464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.859125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.859824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.863415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:58.864427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:58.866312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:58.866739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:58.867617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:58.873087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:58.894701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 799/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:58.894701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.894701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.896958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:58.898540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:58.936581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 781/1580] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:58.941982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:58.979683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a210c-83fc-48b5-87ca-ef82e352e576 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.006405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.007411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.007839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.008434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] PATH_INFO: `/v3/projects/006d7b93d78e4465b196b82a13f73552/users/1c70c6b9fb67481599304eee5eacd949/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.023562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aba62-3b0f-4d15-9200-7016af492606 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.034057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.034702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.036700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.037231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.055906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=006d7b93d78e4465b196b82a13f73552, user_id=1c70c6b9fb67481599304eee5eacd949, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.063514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.068038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.069518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.084800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 782/1581] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:58 2022] PUT /identity/v3/projects/006d7b93d78e4465b196b82a13f73552/users/1c70c6b9fb67481599304eee5eacd949/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:59.089180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.092759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 800/1582] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:59.094262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.110826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bea4b-ef7e-4349-b295-c9473365a8a0 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.128799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:59.222151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a35751-f44e-4e68-bc49-ef3190b4bb8b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.228888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.229669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.230072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.230507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.231458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:55:59.231973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.233934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.234091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.237174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.239355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.239676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.241449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.247857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.250111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 783/1583] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:55:59.254417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.263174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 801/1584] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:59.267477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8292b6-48a4-4a54-91b3-f61354388d25 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.275525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.280119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.280750 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.281031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.281938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.283109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.285264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.288788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ea6-5fde-47d5-99c4-2da7f4d477db admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.296549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.298146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.298506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.298843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] PATH_INFO: `/v3/projects/006d7b93d78e4465b196b82a13f73552/users/1c70c6b9fb67481599304eee5eacd949/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.301293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006d7b93d78e4465b196b82a13f73552, user_id=1c70c6b9fb67481599304eee5eacd949, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.306686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf67e61-e416-4cd7-966c-208d21e659e2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.319621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 802/1585] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:59 2022] PUT /identity/v3/projects/006d7b93d78e4465b196b82a13f73552/users/1c70c6b9fb67481599304eee5eacd949/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:55:59.331897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a173c4-f4fc-4441-8453-263a74c85ff4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.332468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a173c4-f4fc-4441-8453-263a74c85ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.332468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a173c4-f4fc-4441-8453-263a74c85ff4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.334094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 803/1586] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:55:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:55:59.335384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.335672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.336426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.352732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 784/1587] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:55:59 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:55:59.356792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.369743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] MFA Rules not processed for user `1c70c6b9fb67481599304eee5eacd949`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:59.370965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:59.447904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 804/1588] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:59.461086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.462665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:59.470682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c416025-caf3-4c6a-a0e2-e7c1cb0f7391 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.477898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.479753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.480781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.481249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.483041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.488006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254190-f889-4a91-ba47-b6c6c464fd40 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.529223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 785/1589] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:55:59 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:55:59.529223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f166-896e-4251-b8d7-876c8330454f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.529223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f166-896e-4251-b8d7-876c8330454f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.529223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f166-896e-4251-b8d7-876c8330454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.555366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60305c8e-d3b9-4471-9960-fbc63ea89db7 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.564202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.565956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.570960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e580f166-896e-4251-b8d7-876c8330454f None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:55:59.571445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.571949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.573609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e580f166-896e-4251-b8d7-876c8330454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:59.583475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:59.602403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.606301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.622969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 805/1590] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:55:59.637387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.662741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf922e1-96a3-4186-a048-95b21e4a0e1a service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.693756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.694434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.694709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.694979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.695658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.697280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.717955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 806/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:59.717955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.718511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:59.732332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 786/1592] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:55:59.739432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f166-896e-4251-b8d7-876c8330454f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.755660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f166-896e-4251-b8d7-876c8330454f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.767953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.769123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.771125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f9ba-5426-42a9-a861-43fd81bc3374 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.771594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.771959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.772703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.774379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.784585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.785558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.785974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.786381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] PATH_INFO: `/v3/projects/5ce303a962a64c929bef29861a13d747` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.787978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce303a962a64c929bef29861a13d747)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.790955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.809236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 787/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:55:59.809236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.811652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:55:59.813159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:55:59.845804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab378-9708-42da-b326-d51fddf4a4c8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.868474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:55:59.869437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:55:59.870289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:55:59.872235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:55:59.903456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:55:59.905068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:55:59.911745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce303a962a64c929bef29861a13d747', 'request_id': 'req-253dcca4-6890-4ae6-9742-2307abdd9120'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:59.927504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce303a962a64c929bef29861a13d747', 'request_id': 'req-253dcca4-6890-4ae6-9742-2307abdd9120'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:59.953177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 788/1594] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:55:59.954337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:55:59.956336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce303a962a64c929bef29861a13d747', 'request_id': 'req-253dcca4-6890-4ae6-9742-2307abdd9120'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:59.985639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13e21e-50da-4d6f-8b93-8d80a2db283d service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:55:59.990610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] The token cache is being invalidate because project 5ce303a962a64c929bef29861a13d747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:55:59.991308 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:59.994072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:55:59.998130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 807/1595] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:55:59 2022] DELETE /identity/v3/projects/5ce303a962a64c929bef29861a13d747 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:00.003236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:00.004630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.148253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:00.149089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.149648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.150506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] PATH_INFO: `/v3/projects/b9a8a4eb4b7e4b478942ceb2357261d0/users/e602fee97dc943878485683646a7d71c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.162393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dcca4-6890-4ae6-9742-2307abdd9120 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:00.174097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:00.189138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.190545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.190825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] PATH_INFO: `/v3/users/3f2344d464d54bc7b45d750ed2d318f0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.198287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2344d464d54bc7b45d750ed2d318f0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:00.204955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a8a4eb4b7e4b478942ceb2357261d0, user_id=e602fee97dc943878485683646a7d71c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:00.209668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:00.216682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c00820-484c-484e-ad6f-15f473e6c36b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:00.290656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 789/1596] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:55:59 2022] PUT /identity/v3/projects/b9a8a4eb4b7e4b478942ceb2357261d0/users/e602fee97dc943878485683646a7d71c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:00.304218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.305264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.305859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.397173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2344d464d54bc7b45d750ed2d318f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.402093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2344d464d54bc7b45d750ed2d318f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.422797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2344d464d54bc7b45d750ed2d318f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.424068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2344d464d54bc7b45d750ed2d318f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.431460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] MFA Rules not processed for user `e602fee97dc943878485683646a7d71c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:00.432743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.450079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2344d464d54bc7b45d750ed2d318f0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.490276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 808/1597] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:00 2022] DELETE /identity/v3/users/3f2344d464d54bc7b45d750ed2d318f0 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:00.490276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:00.503963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.537374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:00.543090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:00.576187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 790/1598] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:00.580659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:00.582347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.676893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271245d6-ec14-49f4-a1f2-ee8482b9b075 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:00.691678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:00.694104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.694390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.694664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] PATH_INFO: `/v3/users/9ee7bf74d8a24e3d902424303fa5823a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.698760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee7bf74d8a24e3d902424303fa5823a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:00.707864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:00.784353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf1b85-7c73-4583-85d2-8efbf1c0efc2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:00.796557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:00.798172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.803014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.803495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.804323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:00.809517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:00.817382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee7bf74d8a24e3d902424303fa5823a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.818856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee7bf74d8a24e3d902424303fa5823a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.829868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee7bf74d8a24e3d902424303fa5823a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.831202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee7bf74d8a24e3d902424303fa5823a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.840479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-095a1e58-f661-44a8-9311-58f796688b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee7bf74d8a24e3d902424303fa5823a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:00.868106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 791/1599] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:00 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:00.872280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:00.878136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.883151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 809/1600] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:00 2022] DELETE /identity/v3/users/9ee7bf74d8a24e3d902424303fa5823a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:00.888894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:00.890228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:00.892767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:00.924017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:00.926219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:00.983440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071d18c-150d-4938-b6ea-3e6402aae1c4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.016827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 810/1601] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:01.026453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.028248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.084342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.085078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.085249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.085500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.086290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.090190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.104616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:01.129624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 792/1602] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:00 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:01.134716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.148940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbef7e-7d1f-4952-991f-2cfc35e8283f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.156467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.157272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.157556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.157825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.158643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.161317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.175351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 793/1603] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:01.178982 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.184924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:01.185666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60d38-660d-46a2-a645-7f7de9eed9a8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.194699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5325f82-a20d-4c40-b25d-c18b6144f5e9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.197635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.198667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.199692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.200832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.203824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.204921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.205429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.207523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] PATH_INFO: `/v3/projects/39b1231d9bef41f489feb7dc281ee518/users/47be6a8f0eb94b5b84d5f93733f6731a/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.225803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.228866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.230342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1231d9bef41f489feb7dc281ee518, user_id=47be6a8f0eb94b5b84d5f93733f6731a, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.233690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.256059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 794/1604] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:01 2022] PUT /identity/v3/projects/39b1231d9bef41f489feb7dc281ee518/users/47be6a8f0eb94b5b84d5f93733f6731a/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:01.256059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.272420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.272518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 811/1605] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:01.272518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.291245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc05a-835a-443f-a604-3560403cfa01 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.355958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e981-eab0-43c7-8001-04817769bb97 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.361942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.362581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.362895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.363134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] PATH_INFO: `/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.363382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.364331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.364436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf55c3bfed74c5d9d4f9abe7d4d5a7f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.364538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.364805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.365521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.366218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.367335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.382100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 812/1606] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:01.383152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.394131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727a49a-bf12-4c72-b43f-0fb4a4bf39be admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.398630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.399383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.399730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.400255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] PATH_INFO: `/v3/projects/39b1231d9bef41f489feb7dc281ee518/users/47be6a8f0eb94b5b84d5f93733f6731a/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.402291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1231d9bef41f489feb7dc281ee518, user_id=47be6a8f0eb94b5b84d5f93733f6731a, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.405151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb1b60-5c93-45cb-b6a0-da7cac0d4d13 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.419325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 813/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:01 2022] PUT /identity/v3/projects/39b1231d9bef41f489feb7dc281ee518/users/47be6a8f0eb94b5b84d5f93733f6731a/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:01.438644 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf55c3bfed74c5d9d4f9abe7d4d5a7f', 'request_id': 'req-d6faf84e-fd3c-4d27-b52c-392876029c2f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.440512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df21b3-1687-4a11-98e7-57cc10578c5d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.441777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df21b3-1687-4a11-98e7-57cc10578c5d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.442217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df21b3-1687-4a11-98e7-57cc10578c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.446890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf55c3bfed74c5d9d4f9abe7d4d5a7f', 'request_id': 'req-d6faf84e-fd3c-4d27-b52c-392876029c2f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.457712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf55c3bfed74c5d9d4f9abe7d4d5a7f', 'request_id': 'req-d6faf84e-fd3c-4d27-b52c-392876029c2f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.481450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] The token cache is being invalidate because project cdf55c3bfed74c5d9d4f9abe7d4d5a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:01.481956 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.482890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d6faf84e-fd3c-4d27-b52c-392876029c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.486466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 795/1608] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:01 2022] DELETE /identity/v3/projects/cdf55c3bfed74c5d9d4f9abe7d4d5a7f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:01.490519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-54df21b3-1687-4a11-98e7-57cc10578c5d None None] MFA Rules not processed for user `47be6a8f0eb94b5b84d5f93733f6731a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:01.491942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-54df21b3-1687-4a11-98e7-57cc10578c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.492519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.492804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.493075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.526011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:01.527887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.617946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 796/1609] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:01.619051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.626314 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.642434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ac543-f773-48d5-9d97-15f7f5d9e8bf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.647124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 814/1610] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:01.652857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.652979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.653087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.653447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.654410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.654863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.655627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] PATH_INFO: `/v3/projects/62acc9c6b23e40bdab34361355993100` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.659940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=62acc9c6b23e40bdab34361355993100)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.661864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.668714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:01.676547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:01.677808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.690787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 815/1611] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:01.690787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.690787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.741151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62acc9c6b23e40bdab34361355993100', 'request_id': 'req-2222c02d-d992-4aa1-95fa-c670232614bf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.742428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:01.748616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62acc9c6b23e40bdab34361355993100', 'request_id': 'req-2222c02d-d992-4aa1-95fa-c670232614bf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.759295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62acc9c6b23e40bdab34361355993100', 'request_id': 'req-2222c02d-d992-4aa1-95fa-c670232614bf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.770630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8278f5-2a55-4057-b3f9-82fe8da89d7f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.781153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] The token cache is being invalidate because project 62acc9c6b23e40bdab34361355993100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:01.781153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.781548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.783589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 797/1612] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:01 2022] DELETE /identity/v3/projects/62acc9c6b23e40bdab34361355993100 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:01.784222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.787289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.833490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.835009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.835530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.836998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.839616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.880824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c02d-d992-4aa1-95fa-c670232614bf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.887329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.887945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.888479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.888759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.889461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:01.889764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.892293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.912578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 798/1613] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:01.912578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.912578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:01.923911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.925403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.926773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23af7f-f3fc-4da9-b147-a5e8a4f9bd91 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.932661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.933418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.933786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.934062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] PATH_INFO: `/v3/users/1c70c6b9fb67481599304eee5eacd949` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.935511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c70c6b9fb67481599304eee5eacd949)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.937590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.939323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 816/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:01.940641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:01.952186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112b16c-6adc-446e-bb9d-e12e94ea865d service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:01.960191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:01.960923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:01.961426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:01.961793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:01.962681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:01.964985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:01.996389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c70c6b9fb67481599304eee5eacd949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:01.996997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c70c6b9fb67481599304eee5eacd949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.004983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c70c6b9fb67481599304eee5eacd949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.005089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c70c6b9fb67481599304eee5eacd949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.020413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c70c6b9fb67481599304eee5eacd949'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.046488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 817/1615] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:01 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:02.046786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.050261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:02.053567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:02.067111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 799/1616] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:01 2022] DELETE /identity/v3/users/1c70c6b9fb67481599304eee5eacd949 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:02.067111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.079832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:02.193238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0583-6e47-4cda-923b-54342ff0b083 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.197526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602775a-f09f-469b-8996-d859ef3b08ea admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.204105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.204709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.205112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.205222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.206107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.208065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.235343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 800/1617] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:02 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:02.237610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.248891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa5fee-c6be-4af4-843f-ab8445e54ab9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.251270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:02.255309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.255913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.256190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.259468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.260654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.262690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.275536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.276172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.276450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.279759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 801/1618] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:02.279905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.280774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:02.282101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.296474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc059-ab0d-47e3-8638-bbf9280540bf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.305541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.306522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.307013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.307376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.308784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.311092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.330624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 802/1619] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:02.332021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.351265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd4bd5-312f-4863-8c3c-ba86b7608322 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.360692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.362137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.362999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5475d-ab2e-4c27-936c-2ec616a13fcc service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.364189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.364653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.365408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] PATH_INFO: `/v3/projects/06844f48d7af49a8b4942ad5ede45357/users/6b871c4a6b7341c2a585e6bc3da749c1/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.373653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 818/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:02.402712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06844f48d7af49a8b4942ad5ede45357, user_id=6b871c4a6b7341c2a585e6bc3da749c1, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.419175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.462534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 803/1621] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:02 2022] PUT /identity/v3/projects/06844f48d7af49a8b4942ad5ede45357/users/6b871c4a6b7341c2a585e6bc3da749c1/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:02.464831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.465122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.465451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.525957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] MFA Rules not processed for user `6b871c4a6b7341c2a585e6bc3da749c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:02.527231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:02.601821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.603876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:02.662825 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 819/1622] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:02.663934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.736029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad087e88-311e-4a1f-a75f-b810624b10e3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.742150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.743068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.743605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.744084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] PATH_INFO: `/v3/projects/006d7b93d78e4465b196b82a13f73552` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.745557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006d7b93d78e4465b196b82a13f73552)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.751880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.797433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530d88a-25e5-4ebb-92fa-bdd5854785c8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:02.825899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:02.829595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:02.830345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.831762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.832265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.833275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:02.836477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:02.845229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006d7b93d78e4465b196b82a13f73552', 'request_id': 'req-590ff81a-b4a6-4733-b26d-f040413b20a8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.860204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006d7b93d78e4465b196b82a13f73552', 'request_id': 'req-590ff81a-b4a6-4733-b26d-f040413b20a8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.875194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006d7b93d78e4465b196b82a13f73552', 'request_id': 'req-590ff81a-b4a6-4733-b26d-f040413b20a8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.904222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 820/1623] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:02 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:02.904640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] The token cache is being invalidate because project 006d7b93d78e4465b196b82a13f73552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:02.905021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.906546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:02.907928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-590ff81a-b4a6-4733-b26d-f040413b20a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:02.913535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 804/1624] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:02 2022] DELETE /identity/v3/projects/006d7b93d78e4465b196b82a13f73552 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:02.917438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771cca-cf49-44d2-afa0-8bf5695a57f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:02.917732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771cca-cf49-44d2-afa0-8bf5695a57f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:02.918011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771cca-cf49-44d2-afa0-8bf5695a57f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:02.926134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:02.963485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e1771cca-cf49-44d2-afa0-8bf5695a57f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:02.966504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e1771cca-cf49-44d2-afa0-8bf5695a57f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.028718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5d73-d0ac-4d1d-a9db-3cecd11efa25 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.036176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.036816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.037912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.038206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.039963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.043238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.092816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 821/1625] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:02 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:03.097140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.099878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.132349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 805/1626] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:03.134315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b221fc-9f84-49af-b5d8-62ad4c7caf1d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.139732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.140199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.140588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.141288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.142216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.142778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.143199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.145841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.149411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.182448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:03.185581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.192090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 822/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:03.195813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.202445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 806/1628] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:03.207850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.211749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f952c8-1f33-4ba7-a9bd-55e39239eceb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.217054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d43c-e90b-4c40-8272-af49e30d5f28 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.219383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.220110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.220393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.220669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] PATH_INFO: `/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c/users/a2e83755d3c64fd48ef4dbde03e453e0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.222500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.223306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.223721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.224191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.225046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:03.225444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.227161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.244885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 807/1629] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:03.245934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.257315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2fb7c-aef9-4505-b800-f4bd1225b703 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.262316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.263034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.263467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.263835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.264563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.267365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.278629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b3173232ed4121bf1d7bbc0c2f6b1c, user_id=a2e83755d3c64fd48ef4dbde03e453e0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.284503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.316904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 808/1630] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:03.318098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.324645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 823/1631] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:03 2022] PUT /identity/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c/users/a2e83755d3c64fd48ef4dbde03e453e0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:03.329937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.411547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc412d-2179-4f63-b4f0-9dc3d4895644 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.424721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75da75-bdba-4391-8f76-05e13c3b6394 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.436001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.436552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.436889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.437186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.438210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.441459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.462603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 824/1632] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:03.463840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.471253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:03.476491 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c639-6f30-4c55-a39a-1e89b152cc57 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.481569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.482305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.482486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.482754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] PATH_INFO: `/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c/users/a2e83755d3c64fd48ef4dbde03e453e0/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.485759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b3173232ed4121bf1d7bbc0c2f6b1c, user_id=a2e83755d3c64fd48ef4dbde03e453e0, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.488447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150fe2-f841-4c22-a2a8-b7940c750b92 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.500710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.501321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.501653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.501918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.502623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 825/1633] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:03 2022] PUT /identity/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c/users/a2e83755d3c64fd48ef4dbde03e453e0/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:03.502729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.504864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.512713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.513076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.513262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.531915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 809/1634] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:03.540309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.551362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd3e5-48df-441f-a244-d1cb59cf05c1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.552678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] MFA Rules not processed for user `a2e83755d3c64fd48ef4dbde03e453e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:03.553908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.601450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:03.644720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 826/1635] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:03.644987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.645618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.646240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.646349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.647105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.650327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.663365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 810/1636] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:03.665826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.666324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.667519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.678514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372fc6b-c093-439f-9583-53fa9f9acf63 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.692096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.693250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.693613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.694458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.696032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.699396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.712658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 811/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:03.716689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.733007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000154-30e0-4fd8-97b6-f250caded160 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.738151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.738932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.739332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.739727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] PATH_INFO: `/v3/projects/d935e6a60b2043648eb0b97f6205dcdf/users/a9dc314d3bd1471b86b877dbae95eb6f/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.745814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31cd5-cd08-42a5-829c-301479aaa43f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:03.751321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:03.751995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.752269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.752625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.756688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d935e6a60b2043648eb0b97f6205dcdf, user_id=a9dc314d3bd1471b86b877dbae95eb6f, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.759766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04a4b5-96db-4128-8f27-17966e5e9dad admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.763940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:03.766993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:03.782707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 812/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:03 2022] PUT /identity/v3/projects/d935e6a60b2043648eb0b97f6205dcdf/users/a9dc314d3bd1471b86b877dbae95eb6f/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:03.784932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 827/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:03.787510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:03.788395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:03.788395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:03.818128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] MFA Rules not processed for user `a9dc314d3bd1471b86b877dbae95eb6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:03.819430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:03.907450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 813/1640] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:03.916995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:03.925475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4096-a3dc-401a-ba2c-55f4d1cea1d3 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.004588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.005300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.005579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.005858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.006499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.008431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.038127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 828/1641] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:04.042427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.055247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bd9d-7e64-43ca-8cbf-5852080be930 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.069118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:04.132388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.133125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.133413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.133855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.134453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.136765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.161466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 814/1642] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:04 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:04.165553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.176594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b145b-3d9d-46ef-9147-558a891df56e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.181905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.182591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.182944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.184619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.185537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.186202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.188416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.200142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 829/1643] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:04.204478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.214810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca1fb-c2a4-40c4-a329-fb54e4222b32 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.220293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.220945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.221222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.221494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] PATH_INFO: `/v3/projects/cafd190d375842358fc4b874315aba0f/users/58c5a79f4ed244f6805122cf4b8640e9/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.238007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafd190d375842358fc4b874315aba0f, user_id=58c5a79f4ed244f6805122cf4b8640e9, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.240616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.257085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 830/1644] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:04 2022] PUT /identity/v3/projects/cafd190d375842358fc4b874315aba0f/users/58c5a79f4ed244f6805122cf4b8640e9/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:04.260092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf82c0-5b75-4a5a-9b84-1ad03cc28260 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.261631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.294610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:04.352695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3d10-b5d7-4b6b-9073-7d194652ff3b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.354397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2e83755d3c64fd48ef4dbde03e453e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.355025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.355324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.355688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.356496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:04.358681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.359550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.360728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.360874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.361355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.361855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.363202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.365776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.379578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 815/1645] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:04.380405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.392641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0941-159d-4c9e-b79b-9232b33e3832 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.397301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 831/1646] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:04.402967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2e83755d3c64fd48ef4dbde03e453e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.404709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.405598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.406688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.407205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.408713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.412619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.446613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5af0-e4fe-4862-bebb-a239dc2e8ea7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.465808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.465808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.465808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.466155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] PATH_INFO: `/v3/projects/cafd190d375842358fc4b874315aba0f/users/58c5a79f4ed244f6805122cf4b8640e9/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.467163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 816/1647] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:04 2022] POST /identity/v3/projects => generated 353 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:04.468425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.492978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafd190d375842358fc4b874315aba0f, user_id=58c5a79f4ed244f6805122cf4b8640e9, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.510468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d7b1c-29b4-473f-a2b2-678acacd39c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.565156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 832/1648] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:04 2022] PUT /identity/v3/projects/cafd190d375842358fc4b874315aba0f/users/58c5a79f4ed244f6805122cf4b8640e9/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:04.566904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.567194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.567558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.571791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:04.634142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] MFA Rules not processed for user `58c5a79f4ed244f6805122cf4b8640e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:04.635767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:04.683052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96298989-720b-4a2d-b6d5-adbdccafb6da tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.798209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 833/1649] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:04.814326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.817359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2e83755d3c64fd48ef4dbde03e453e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.818034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.818320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.818593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.819249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:04.819581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.822318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:04.851528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 817/1650] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:04.959015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:04.975154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904f3c-d670-4b3e-9f23-3ea40bf86fa2 tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.976398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1e66e-827c-41d6-97a7-71fefe48588c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:04.983115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.983683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2e83755d3c64fd48ef4dbde03e453e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:04.984503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.985002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.985359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.986529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:04.987081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:04.988204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] PATH_INFO: `/v3/projects/8847cd915b154745a34578cee57414e8` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:04.990201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8847cd915b154745a34578cee57414e8)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:04.993162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:05.090741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:05.095578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8847cd915b154745a34578cee57414e8', 'request_id': 'req-b3625f89-1bc1-445c-b084-801bb3c4875a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.113708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8847cd915b154745a34578cee57414e8', 'request_id': 'req-b3625f89-1bc1-445c-b084-801bb3c4875a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.128210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8847cd915b154745a34578cee57414e8', 'request_id': 'req-b3625f89-1bc1-445c-b084-801bb3c4875a'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.143367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:05.145205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87a541-5f32-4aaf-bbd5-147a12039de1 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:05.149826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] The token cache is being invalidate because project 8847cd915b154745a34578cee57414e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:05.150374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.151966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.155738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 818/1651] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:04 2022] DELETE /identity/v3/projects/8847cd915b154745a34578cee57414e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:05.160259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 834/1652] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:05.674370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:05.675965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:05.764099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:05.780429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3625f89-1bc1-445c-b084-801bb3c4875a tempest-VolumeQuotaClassesTest-2119974907 tempest-VolumeQuotaClassesTest-2119974907-project-admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:05.785980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:05.786690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:05.787038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:05.787339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] PATH_INFO: `/v3/users/6b871c4a6b7341c2a585e6bc3da749c1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:05.788495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b871c4a6b7341c2a585e6bc3da749c1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:05.790501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:05.840222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b871c4a6b7341c2a585e6bc3da749c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.840911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b871c4a6b7341c2a585e6bc3da749c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.850192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b871c4a6b7341c2a585e6bc3da749c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.850857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b871c4a6b7341c2a585e6bc3da749c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.860422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b871c4a6b7341c2a585e6bc3da749c1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:05.880312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 819/1653] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:05 2022] DELETE /identity/v3/users/6b871c4a6b7341c2a585e6bc3da749c1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:05.884588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:05.884876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:05.885149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:05.905643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:05.907341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:05.975130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 835/1654] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:05.985201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:05.986653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.051821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff84734-8a70-40a9-84d9-b667b4954603 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.055736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.056348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.056628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.056898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.067570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:06.068940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:06.080418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 820/1655] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:06.217915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.220410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.236960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ff1d6-c389-41ce-a9aa-2a7a3dc6945b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.242629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.243479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.243902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.244333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] PATH_INFO: `/v3/users/2c5d59e2038f40b985e55ecd4d1345f9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.245705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5d59e2038f40b985e55ecd4d1345f9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:06.247974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:06.287148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.288660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.314174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499b29-5e2b-4796-8216-66316862317d service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.325657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.326215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.326489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.326771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] PATH_INFO: `/v3/users/e602fee97dc943878485683646a7d71c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.330386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e602fee97dc943878485683646a7d71c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:06.335028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:06.338338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5d59e2038f40b985e55ecd4d1345f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.339582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5d59e2038f40b985e55ecd4d1345f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.358314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5d59e2038f40b985e55ecd4d1345f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.359162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5d59e2038f40b985e55ecd4d1345f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.377318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-31305828-c70a-4f49-9e3f-56b2c89cbd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5d59e2038f40b985e55ecd4d1345f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.412218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 836/1656] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:06 2022] DELETE /identity/v3/users/2c5d59e2038f40b985e55ecd4d1345f9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:06.417513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.418823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.419498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.430714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e602fee97dc943878485683646a7d71c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.431483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e602fee97dc943878485683646a7d71c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.446068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e602fee97dc943878485683646a7d71c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.447432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e602fee97dc943878485683646a7d71c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.451100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:06.452585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.466392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9331c0cb-18d6-4be0-a547-5ff307d5fc73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e602fee97dc943878485683646a7d71c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.472843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:06.504128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 821/1657] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:06 2022] DELETE /identity/v3/users/e602fee97dc943878485683646a7d71c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:06.505719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.506012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.506287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.537496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:06.538988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.550735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:06.574439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 837/1658] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:06.584572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.586357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.637112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 822/1659] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:06.642153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.643802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.657591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b40f-b6bb-4229-a234-9bdf6b3cae2f None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.663947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.665415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.665774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.666124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] PATH_INFO: `/v3/projects/06844f48d7af49a8b4942ad5ede45357` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.670024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06844f48d7af49a8b4942ad5ede45357)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:06.672137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:06.700364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b62e5-f5f0-4650-ab96-b975c93845cc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.795364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.796132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.796812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.797274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:06.804261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06844f48d7af49a8b4942ad5ede45357', 'request_id': 'req-225f2316-06fa-4f20-b705-c835f65e1805'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.812869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06844f48d7af49a8b4942ad5ede45357', 'request_id': 'req-225f2316-06fa-4f20-b705-c835f65e1805'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.820772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:06.822337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:06.833442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06844f48d7af49a8b4942ad5ede45357', 'request_id': 'req-225f2316-06fa-4f20-b705-c835f65e1805'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.863742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 838/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:06.865670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.866087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] The token cache is being invalidate because project 06844f48d7af49a8b4942ad5ede45357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:06.868780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.873603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:06.877191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 823/1661] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:06 2022] DELETE /identity/v3/projects/06844f48d7af49a8b4942ad5ede45357 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:06.880865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:06.883698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:06.903345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6515-db02-49f7-b404-242aa039258b service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:06.997109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:06.998175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:06.998593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:06.999022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:07.005033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:07.012445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f2316-06fa-4f20-b705-c835f65e1805 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:07.020778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:07.021563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:07.021908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:07.022483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] PATH_INFO: `/v3/users/a2e83755d3c64fd48ef4dbde03e453e0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:07.024636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e83755d3c64fd48ef4dbde03e453e0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:07.027215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:07.035455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:07.037193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:07.048052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:07.052501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 839/1662] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:07.109400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e83755d3c64fd48ef4dbde03e453e0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.110323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e83755d3c64fd48ef4dbde03e453e0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.120346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e83755d3c64fd48ef4dbde03e453e0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.121135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e83755d3c64fd48ef4dbde03e453e0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.133100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e83755d3c64fd48ef4dbde03e453e0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.161928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 824/1663] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:06 2022] DELETE /identity/v3/users/a2e83755d3c64fd48ef4dbde03e453e0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:07.629019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:07.630553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:07.649063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e13332-5719-4df8-9165-105b1575ef6a service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:07.728345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:07.730254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:07.780391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:07.781708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:07.781996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:07.782259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] PATH_INFO: `/v3/projects/2f297f9a6b4548f18d51f9580925ee0e` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:07.783510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f297f9a6b4548f18d51f9580925ee0e)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:07.785482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:07.799104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:07.882342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ac20-bab6-41f6-9943-cfa556f8e763 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:07.900647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f297f9a6b4548f18d51f9580925ee0e', 'request_id': 'req-c0738653-c0d2-4684-bc11-81d2f7ae9726'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.931384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f297f9a6b4548f18d51f9580925ee0e', 'request_id': 'req-c0738653-c0d2-4684-bc11-81d2f7ae9726'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.942223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f297f9a6b4548f18d51f9580925ee0e', 'request_id': 'req-c0738653-c0d2-4684-bc11-81d2f7ae9726'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.961576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] The token cache is being invalidate because project 2f297f9a6b4548f18d51f9580925ee0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:07.962067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.963121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:07.965364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 840/1664] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:07 2022] DELETE /identity/v3/projects/2f297f9a6b4548f18d51f9580925ee0e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:07.966425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:07.968332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:07.973267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:07.973920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:07.974198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:07.974470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] PATH_INFO: `/v3/projects/b9a8a4eb4b7e4b478942ceb2357261d0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:07.975719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a8a4eb4b7e4b478942ceb2357261d0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:07.977752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:07.993851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738653-c0d2-4684-bc11-81d2f7ae9726 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:07.998766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:07.999579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.000073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.000559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] PATH_INFO: `/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.001897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b3173232ed4121bf1d7bbc0c2f6b1c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.003926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.027267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:08.039913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a8a4eb4b7e4b478942ceb2357261d0', 'request_id': 'req-40e68cdf-0f39-4457-a360-be18b8e56b97'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.046662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a8a4eb4b7e4b478942ceb2357261d0', 'request_id': 'req-40e68cdf-0f39-4457-a360-be18b8e56b97'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.055873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a8a4eb4b7e4b478942ceb2357261d0', 'request_id': 'req-40e68cdf-0f39-4457-a360-be18b8e56b97'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.069306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] The token cache is being invalidate because project b9a8a4eb4b7e4b478942ceb2357261d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:08.069619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.070326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40e68cdf-0f39-4457-a360-be18b8e56b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.071951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 825/1665] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:07 2022] DELETE /identity/v3/projects/b9a8a4eb4b7e4b478942ceb2357261d0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:08.075227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc290-5790-4d3a-9799-77df77f8e1ce None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.075227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc290-5790-4d3a-9799-77df77f8e1ce None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.075227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcc290-5790-4d3a-9799-77df77f8e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.080623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'request_id': 'req-166d987d-9331-491a-833c-13d3563d299b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.089935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'request_id': 'req-166d987d-9331-491a-833c-13d3563d299b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.097412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b3173232ed4121bf1d7bbc0c2f6b1c', 'request_id': 'req-166d987d-9331-491a-833c-13d3563d299b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.098341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-39fcc290-5790-4d3a-9799-77df77f8e1ce None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:08.099593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-39fcc290-5790-4d3a-9799-77df77f8e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.109217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] The token cache is being invalidate because project 83b3173232ed4121bf1d7bbc0c2f6b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:08.109578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.110222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.115177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 841/1666] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:07 2022] DELETE /identity/v3/projects/83b3173232ed4121bf1d7bbc0c2f6b1c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:08.115177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.116170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.170836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 826/1667] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:08.172482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f97d-b34f-47bf-93ba-56f8cca59fb7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.172771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f97d-b34f-47bf-93ba-56f8cca59fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.173108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4f97d-b34f-47bf-93ba-56f8cca59fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.194951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d987d-9331-491a-833c-13d3563d299b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.199367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8de4f97d-b34f-47bf-93ba-56f8cca59fb7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:08.200581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8de4f97d-b34f-47bf-93ba-56f8cca59fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.201421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.202065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.202415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.202861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] PATH_INFO: `/v3/users/47be6a8f0eb94b5b84d5f93733f6731a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.204120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47be6a8f0eb94b5b84d5f93733f6731a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.206474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.211339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 827/1668] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:08.211339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916905a7-2a77-4243-a069-0879be77ee18 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.211339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916905a7-2a77-4243-a069-0879be77ee18 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.211339 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916905a7-2a77-4243-a069-0879be77ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.233591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:08.241159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-916905a7-2a77-4243-a069-0879be77ee18 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:08.242358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-916905a7-2a77-4243-a069-0879be77ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.255416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 828/1669] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:08.257488 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.258450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.259706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.276354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47be6a8f0eb94b5b84d5f93733f6731a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.277192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47be6a8f0eb94b5b84d5f93733f6731a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.286906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47be6a8f0eb94b5b84d5f93733f6731a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.288481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47be6a8f0eb94b5b84d5f93733f6731a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.300551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47be6a8f0eb94b5b84d5f93733f6731a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:08.309424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:08.311642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.329015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 842/1670] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:08 2022] DELETE /identity/v3/users/47be6a8f0eb94b5b84d5f93733f6731a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:08.330232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.331870 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:08.332619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 829/1671] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:08.337605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.375048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1a1c-6d8c-4d1a-8b27-e2503b6ccba1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.425052 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2076ead-02fd-48df-9596-9a6b0560010b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.430034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.430855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.431027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.431538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.432264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:08.432698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.434461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.448756 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 843/1672] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:08.458877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.467260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.468093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.469130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.469702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.470355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23856f-87f8-4b9a-b6a0-3a8b94164f3e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.470758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:08.471199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.473195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.475862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.477327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.477685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.478026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.478790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.480967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.496077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 830/1673] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:08.497261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.513745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725aba2-fa10-4395-b3e9-746b755305a3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.524125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.525192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.525635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.525907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.526798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.533453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.534202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 844/1674] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:08.535371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.578910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 831/1675] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:08.583147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.612368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:08.647194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f072-4a1c-43f2-b809-ee38c402b15c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.662306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:08.721046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578628d2-e10e-4dab-a464-37cfe76f3e2a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.730362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.733266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.733603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.734027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.734764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.740492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.752169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.753168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.753676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.754273 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.756196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.758490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.777715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 832/1676] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:08.782813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.787983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 845/1677] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:08 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:08.792695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.799114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f179e-9ef4-41af-a2dd-f43460d024f6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.805514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.806322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.806627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001ee25-bd0c-4f92-a2c2-5e096b1ee4d3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.807009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.807486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.808438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.810203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.814435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.815035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.815502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.815774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.817470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.820408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.835716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 833/1678] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:08.837590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.845512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 846/1679] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:08.851061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.861001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eef33-553c-40d0-ba52-1daf011a135c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.872563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.888011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.888011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.889221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96011c-bbb0-4fa5-9c80-c7d8e6cb07da admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.889326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.889326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.889326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.898194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.900872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.904255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.904480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.905150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:08.910788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:08.928673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 834/1680] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:08.930437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.947168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 847/1681] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:08.949796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:08.961850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6333f-6dd2-4d7c-a583-7afec3862b5b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.964343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e6f-d089-4805-acd3-30b8759ae258 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:08.970297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.971199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:08.971418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.971949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.972049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:08.972283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:08.972550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] PATH_INFO: `/v3/projects/a75703eb97914d71b758e27f7f0db3cd/users/b8b7427331364080aefdf076f3d55739/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:08.972674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] PATH_INFO: `/v3/projects/32d2b9ec54df4b3fbfec5c0668cf4064/users/5f95d6584e934888b656c02cea7cb41c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.000784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d2b9ec54df4b3fbfec5c0668cf4064, user_id=5f95d6584e934888b656c02cea7cb41c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.006526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e253-5447-4ff8-95d9-0a8d79828de5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.008685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75703eb97914d71b758e27f7f0db3cd, user_id=b8b7427331364080aefdf076f3d55739, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.014528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff5447-616d-4fd9-b74e-07dc757cf8d5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.043400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 835/1682] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:08 2022] PUT /identity/v3/projects/32d2b9ec54df4b3fbfec5c0668cf4064/users/5f95d6584e934888b656c02cea7cb41c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:09.057107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.057631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.057997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.063742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 848/1683] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:08 2022] PUT /identity/v3/projects/a75703eb97914d71b758e27f7f0db3cd/users/b8b7427331364080aefdf076f3d55739/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:09.068914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.069185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.069453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.112804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] MFA Rules not processed for user `5f95d6584e934888b656c02cea7cb41c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:09.114062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.116123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] MFA Rules not processed for user `b8b7427331364080aefdf076f3d55739`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:09.117436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.215078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 836/1684] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:09.219700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.237247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 849/1685] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:09.251232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.252783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.292325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:09.310263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3399-ec0c-46e1-864a-d2caa6635cf0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.316126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.316847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.317217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.317485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.318175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.320582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.324084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:09.337082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1017a3b-61af-4b62-9029-40d38f3a3c58 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.344951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.345805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.346189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.346574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.360670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 837/1686] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:09.360854 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.362736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.363730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.381489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 850/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:09.431787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.433302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.456584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23e3e-0d61-451b-a9fa-bea845e0432b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.468522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.470221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.470605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.471455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.472297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.474348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.481017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96b65-c6c4-4e98-9bf7-555558755ff3 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.506231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.507004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.507307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.507610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] PATH_INFO: `/v3/projects/39b1231d9bef41f489feb7dc281ee518` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.509700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b1231d9bef41f489feb7dc281ee518)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.511715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.528495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 838/1688] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:09.529676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.542978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57dc8b-9fb9-487b-8cc6-98e942aac02f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.550074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.551042 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.551877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.552154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.552882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.554581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.572300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 839/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:09.573635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.584779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870235-a468-41f7-8a6d-75cd7cac9892 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.586730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b1231d9bef41f489feb7dc281ee518', 'request_id': 'req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:09.596685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b1231d9bef41f489feb7dc281ee518', 'request_id': 'req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:09.607695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b1231d9bef41f489feb7dc281ee518', 'request_id': 'req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:09.622093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] The token cache is being invalidate because project 39b1231d9bef41f489feb7dc281ee518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:09.622475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:09.623414 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9590c88b-d67b-4965-a4c0-7f8f54cc4c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:09.630577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 851/1690] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:09 2022] DELETE /identity/v3/projects/39b1231d9bef41f489feb7dc281ee518 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:09.633078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863acca-3de6-49b2-b19d-47950d4397b2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.633446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863acca-3de6-49b2-b19d-47950d4397b2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.633767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863acca-3de6-49b2-b19d-47950d4397b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.660060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.660849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.661198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.661538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] PATH_INFO: `/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe/users/948d8dc5481547b19ffb32cf33700ca9/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.673215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e863acca-3de6-49b2-b19d-47950d4397b2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:09.676788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e863acca-3de6-49b2-b19d-47950d4397b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.693147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 852/1691] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:09.696413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f0ca7d150246e6b0b2f2d8f104d0fe, user_id=948d8dc5481547b19ffb32cf33700ca9, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.699166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.700765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a88b4-2100-45b1-afda-45713044b972 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.701392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a88b4-2100-45b1-afda-45713044b972 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.702563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a88b4-2100-45b1-afda-45713044b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.721462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 840/1692] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:09 2022] PUT /identity/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe/users/948d8dc5481547b19ffb32cf33700ca9/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:09.725856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.727769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.740636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-109a88b4-2100-45b1-afda-45713044b972 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:09.742137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-109a88b4-2100-45b1-afda-45713044b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:09.793902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:09.850438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a072b2-7cc2-4a49-bb71-949b29bc658d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.855681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.856572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.857077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.857567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.858614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.861124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.879578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 841/1693] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:09.883473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.890397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 853/1694] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:09.894281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a88b4-2100-45b1-afda-45713044b972 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.897897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092eeb-9f82-4b3f-bd0f-502c61a956bb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.904122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.904929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.905214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.905485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] PATH_INFO: `/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe/users/948d8dc5481547b19ffb32cf33700ca9/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.906693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a88b4-2100-45b1-afda-45713044b972 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.908322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f0ca7d150246e6b0b2f2d8f104d0fe, user_id=948d8dc5481547b19ffb32cf33700ca9, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.912395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de5c16-40a3-4058-8994-29c683aad546 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.913216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:09.914147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.914650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.915372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.916812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:09.917454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:09.919315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:09.933200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 854/1695] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:09.940672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 842/1696] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:09 2022] PUT /identity/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe/users/948d8dc5481547b19ffb32cf33700ca9/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:09.940829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:09.947055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:09.947384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:09.947870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:09.954444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c78a5f-a762-4eb4-bc4c-7d209a128da9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:09.988226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] MFA Rules not processed for user `948d8dc5481547b19ffb32cf33700ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:09.993619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.045042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:10.067223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.069402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.069686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.070137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.070688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.072739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.160854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 843/1697] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:10.167196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.175339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 855/1698] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:09 2022] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:10.175500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.177170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.278337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce90bf-65d9-435b-bb4d-433858abb691 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.284701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.286064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.286346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.286677 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.287417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.287810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09b46-2a81-4f58-b619-90ec27301f1c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.292613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.349470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 856/1699] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:10 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:10.350483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.353928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.399908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.400837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.401279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.402091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.404801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.421780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:10.445607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455ec5b-39a9-4b9f-9596-ed6c2ecae58f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.450701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.451474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.451866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.452223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.497037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.501163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.511616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 844/1700] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:10.512532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.524839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f8f2f-338c-486e-9674-d5ad8221035f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.532756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.533615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.534121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.534572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.535445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.537417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.553459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 845/1701] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:10.559358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.570381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155a2a-1947-47ef-b1b1-179764a0c3d3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.575772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.576382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.576663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.577460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.577702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.579380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.590542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 846/1702] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:10.595576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.611078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600356-d613-42de-8e31-6bd2d27f3caf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.612890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.614367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cfa3d-f2b5-4464-a600-a2be7ed4a446 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.621876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.623861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.624904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.625207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] PATH_INFO: `/v3/projects/270d7e70eeb9423bb290086a5729bb17/users/6c6e1a65c17e41a28ea5130696cf8aa2/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.635257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 857/1703] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:10.656250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270d7e70eeb9423bb290086a5729bb17, user_id=6c6e1a65c17e41a28ea5130696cf8aa2, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:10.659778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:10.690514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 847/1704] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:10 2022] PUT /identity/v3/projects/270d7e70eeb9423bb290086a5729bb17/users/6c6e1a65c17e41a28ea5130696cf8aa2/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:10.703312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.703312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.703312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.751682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:10.791081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] MFA Rules not processed for user `6c6e1a65c17e41a28ea5130696cf8aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:10.793964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.807260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:10.915575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2662-5ced-4512-9533-c9f38a40b555 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:10.928633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:10.932082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:10.932388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:10.932777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:10.939311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:10.950082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 858/1705] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:10.955247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.076663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5955bad-ddab-485a-905c-19f3de7e0f40 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.078351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.080416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.088153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.088796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.089112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.089344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.091906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.095826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.122081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 848/1706] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:11.154724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 859/1707] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:10 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:11.159559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.176283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b6b30-90a1-40fd-b71c-b8a5e8c3eeb1 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.224659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:11.332789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.333416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.333694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.333964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.334853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.340509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.422857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 849/1708] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:11 2022] POST /identity/v3/users => generated 301 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:11.427876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.446670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d03a-1ad0-4c7e-8574-d356fa07e69c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.461826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.463706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.464192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.464646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.478706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.484625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.505271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 860/1709] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:11.509335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.536555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb19a-a41e-4160-bb28-2f876c5fed08 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.571160 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.572552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.573004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.573522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] PATH_INFO: `/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141/users/81a6a4d03e074f1995fffa05109025d6/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.623034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252ee45b6c6a4ce28d3ca1732ba69141, user_id=81a6a4d03e074f1995fffa05109025d6, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.637168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.690415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 850/1710] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:11 2022] PUT /identity/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141/users/81a6a4d03e074f1995fffa05109025d6/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:11.692654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.706536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ede60-9514-4441-afbc-f1d5f56228ba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.867820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.870012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.870364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.870660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.872566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.878407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670861c-7732-4366-907c-0c3c3010695e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:11.909690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 861/1711] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:11.914322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:11.935762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d27c-744a-4de8-9914-0b373396b740 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:11.954518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:11.958423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:11.959715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:11.960132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] PATH_INFO: `/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141/users/81a6a4d03e074f1995fffa05109025d6/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:11.965150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=252ee45b6c6a4ce28d3ca1732ba69141, user_id=81a6a4d03e074f1995fffa05109025d6, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:11.969338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:12.023313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 851/1712] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:11 2022] PUT /identity/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141/users/81a6a4d03e074f1995fffa05109025d6/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:12.033597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:12.033965 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:12.034334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:12.086489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] MFA Rules not processed for user `81a6a4d03e074f1995fffa05109025d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:12.087880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:12.092551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:12.190451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 862/1713] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:12.201773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:12.281445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37448c5a-5cf3-4a5f-89eb-e59ee3ffb8dd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:12.288325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:12.289639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:12.290084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:12.290989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:12.319469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:12.321147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42840c36-3a33-4449-83f6-76739bc49dd4 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:12.335847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 852/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:12.603025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:12.694010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dddd8b-0e9b-475b-9b7c-197f607603ee None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:12.701928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:12.703248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:12.703456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:12.703680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] PATH_INFO: `/v3/users/6c6e1a65c17e41a28ea5130696cf8aa2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:12.705091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6e1a65c17e41a28ea5130696cf8aa2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:12.707749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:12.780723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6e1a65c17e41a28ea5130696cf8aa2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:12.782517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6e1a65c17e41a28ea5130696cf8aa2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:12.803493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6e1a65c17e41a28ea5130696cf8aa2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:12.819376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6e1a65c17e41a28ea5130696cf8aa2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:12.830241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6e1a65c17e41a28ea5130696cf8aa2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:12.872408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 863/1715] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:12 2022] DELETE /identity/v3/users/6c6e1a65c17e41a28ea5130696cf8aa2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:12.877189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:12.877846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:12.878174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:12.899914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:12.901286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:12.982402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 853/1716] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:12.996632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:12.998413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:13.027620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:13.126586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856b5c2-d6c2-47f6-913c-124ac4f42a59 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:13.138300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:13.139451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:13.143354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:13.143836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:13.170169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:13.172330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:13.194624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 864/1717] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:13.633446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:13.636656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:13.652127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d8e7-2ee4-45fa-95f5-fbfa6410e695 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:13.658416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:13.659425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:13.659880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:13.660306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] PATH_INFO: `/v3/users/b8b7427331364080aefdf076f3d55739` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:13.661650 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b7427331364080aefdf076f3d55739)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:13.663908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:13.676975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:13.755481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b7427331364080aefdf076f3d55739'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.756216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:13.756672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b7427331364080aefdf076f3d55739'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.758873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:13.767551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b7427331364080aefdf076f3d55739'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.768789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b7427331364080aefdf076f3d55739'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.782268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12b56-b925-4c6c-bef7-22e875540470 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:13.783658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c9823954-7fd8-42f2-95c6-bff634727d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b7427331364080aefdf076f3d55739'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.793026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:13.794224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:13.794640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:13.795047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] PATH_INFO: `/v3/projects/270d7e70eeb9423bb290086a5729bb17` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:13.808263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=270d7e70eeb9423bb290086a5729bb17)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:13.836818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 854/1718] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:13 2022] DELETE /identity/v3/users/b8b7427331364080aefdf076f3d55739 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:13.838684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:13.839031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:13.839562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:13.854281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:13.882503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:13.890320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:13.929985 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270d7e70eeb9423bb290086a5729bb17', 'request_id': 'req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.949390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270d7e70eeb9423bb290086a5729bb17', 'request_id': 'req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.960896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270d7e70eeb9423bb290086a5729bb17', 'request_id': 'req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.978686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 855/1719] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:13.986142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] The token cache is being invalidate because project 270d7e70eeb9423bb290086a5729bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:13.986574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.987388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:13.990268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:13.992101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:13.994648 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 865/1720] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:13 2022] DELETE /identity/v3/projects/270d7e70eeb9423bb290086a5729bb17 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:13.995698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:13.997130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:14.113601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84761b-926b-45af-ae64-e2171d487ea2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:14.145718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0639a5-3361-4a3b-b1b8-4a7549a508cf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:14.152426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:14.154144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:14.154829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:14.155252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] PATH_INFO: `/v3/users/81a6a4d03e074f1995fffa05109025d6` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:14.157890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a6a4d03e074f1995fffa05109025d6)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:14.182857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:14.234428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:14.246999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:14.247815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:14.248199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:14.248630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:14.257236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:14.315550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:14.321407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:14.348322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 856/1721] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:14.367783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a6a4d03e074f1995fffa05109025d6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:14.369723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a6a4d03e074f1995fffa05109025d6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:14.371259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:14.414279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a6a4d03e074f1995fffa05109025d6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:14.415227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a6a4d03e074f1995fffa05109025d6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:14.444963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b2443ebb-a422-4436-8fdd-74b47fe2202d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a6a4d03e074f1995fffa05109025d6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:14.516932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 866/1722] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:13 2022] DELETE /identity/v3/users/81a6a4d03e074f1995fffa05109025d6 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:15.108936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:15.111864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:15.143729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98786-310c-4e0d-afe1-500de3c96a4b service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:15.319958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:15.321134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.321592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.322081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] PATH_INFO: `/v3/projects/a75703eb97914d71b758e27f7f0db3cd` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.324958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75703eb97914d71b758e27f7f0db3cd)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:15.329445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:15.414069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75703eb97914d71b758e27f7f0db3cd', 'request_id': 'req-ffcc36ba-d099-48ad-9112-05ba936561a4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.424566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75703eb97914d71b758e27f7f0db3cd', 'request_id': 'req-ffcc36ba-d099-48ad-9112-05ba936561a4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.451133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75703eb97914d71b758e27f7f0db3cd', 'request_id': 'req-ffcc36ba-d099-48ad-9112-05ba936561a4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.474290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] The token cache is being invalidate because project a75703eb97914d71b758e27f7f0db3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:15.475717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.478199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ffcc36ba-d099-48ad-9112-05ba936561a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.486954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 857/1723] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:15 2022] DELETE /identity/v3/projects/a75703eb97914d71b758e27f7f0db3cd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:15.493679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.494232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.495114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.548599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:15.549843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:15.660301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 867/1724] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:15.669039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.669432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.669808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.691616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:15.694453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:15.721321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:15.722643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:15.736733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 858/1725] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:15.737669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:15.738770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c645b-056d-435f-9f35-c30b7045471f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:15.755196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4a448-ffc0-4533-bb0c-f46b05330292 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:15.761906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:15.762884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.763333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.763745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.764679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:15.765198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:15.768994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:15.772455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:15.773190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.773544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.773950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] PATH_INFO: `/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.775433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252ee45b6c6a4ce28d3ca1732ba69141)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:15.778376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:15.787175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 859/1726] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:15.792218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:15.804425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0289d-a4fb-45db-a084-7c25e9486dea admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:15.809903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:15.810733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.811463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.812670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.813483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:15.815612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:15.863482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252ee45b6c6a4ce28d3ca1732ba69141', 'request_id': 'req-600b7023-4c38-4d2c-b2a2-f95a260a2044'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.872767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252ee45b6c6a4ce28d3ca1732ba69141', 'request_id': 'req-600b7023-4c38-4d2c-b2a2-f95a260a2044'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.873049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 860/1727] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:15 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:15.878137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:15.896305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252ee45b6c6a4ce28d3ca1732ba69141', 'request_id': 'req-600b7023-4c38-4d2c-b2a2-f95a260a2044'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.923069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] The token cache is being invalidate because project 252ee45b6c6a4ce28d3ca1732ba69141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:15.923356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.924546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-600b7023-4c38-4d2c-b2a2-f95a260a2044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:15.929947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 868/1728] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:15 2022] DELETE /identity/v3/projects/252ee45b6c6a4ce28d3ca1732ba69141 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:15.931961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d20f-3331-40e9-beef-e2220b88c744 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:15.932332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d20f-3331-40e9-beef-e2220b88c744 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:15.932699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d20f-3331-40e9-beef-e2220b88c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:15.944380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:15.968763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a195d20f-3331-40e9-beef-e2220b88c744 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:15.970086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a195d20f-3331-40e9-beef-e2220b88c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.007848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec9616-a06d-4ea2-bc06-750c88885366 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.021986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.023064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.023660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.024524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.025261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.027737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.054473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.056303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 861/1729] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:15 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:16.068215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.070740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.075241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 869/1730] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:16.085313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.085810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06965e47-67db-4ac0-baeb-420272fa6d23 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.086214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.086777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.091037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.091805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.092176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.092546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.093498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.095223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.106302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 862/1731] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:16.110759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.113014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:16.114367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.122568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7fc03-8cf5-4ec4-a707-1708fb6b2dc9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.125542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 870/1732] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:16.130134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.132480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.133188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.133723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.134091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.134831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.137215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.140969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a31a9-1cb9-4b25-ba1d-2f246a603341 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.147044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.147755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.148087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.148361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.149150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:16.149400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.151325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 863/1733] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:16.151447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.154161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.164461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ed7d3-1af5-470f-92da-5faf3ecfb79c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.164956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 871/1734] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:16.168999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.170687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.172101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.172448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.172781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] PATH_INFO: `/v3/projects/b275286be4634c5f8def564b73b5dead/users/623122bdc22249e1a0c67a2a49a85d16/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.179625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcafe4-8d81-4f4b-83ec-59e757f24846 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.184629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.185280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.185561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.185834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.186676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.189540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.193169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b275286be4634c5f8def564b73b5dead, user_id=623122bdc22249e1a0c67a2a49a85d16, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.197029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d91d4-75bf-404d-aafb-456c9958f773 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.214304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 864/1735] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:16 2022] PUT /identity/v3/projects/b275286be4634c5f8def564b73b5dead/users/623122bdc22249e1a0c67a2a49a85d16/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:16.229951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 872/1736] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:16.231517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.232889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.233332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.234398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.273527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] MFA Rules not processed for user `623122bdc22249e1a0c67a2a49a85d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:16.274778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.316953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfca12-dfeb-430e-987c-427fb140e016 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.322833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.323494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.323763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.327007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.327007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.327007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.360193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 873/1737] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:16.361097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.364505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.376799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 865/1738] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:16.377546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.377758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd141f-2da7-490f-a36f-99a18d226f60 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.384962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.385915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.386376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.386826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] PATH_INFO: `/v3/users/a9dc314d3bd1471b86b877dbae95eb6f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.388237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dc314d3bd1471b86b877dbae95eb6f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.388477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe680a-37db-475b-b017-2c96830af195 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.390690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.393184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.393837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.394110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.394402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.395172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.396779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.410708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 866/1739] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:16.410708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.410708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.440906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dc314d3bd1471b86b877dbae95eb6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:16.441655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dc314d3bd1471b86b877dbae95eb6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:16.448749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dc314d3bd1471b86b877dbae95eb6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:16.449404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dc314d3bd1471b86b877dbae95eb6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:16.456874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dc314d3bd1471b86b877dbae95eb6f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:16.475097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 874/1740] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:16 2022] DELETE /identity/v3/users/a9dc314d3bd1471b86b877dbae95eb6f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:16.478035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.478035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.481707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.489144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.500147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45f80f-d033-46da-9ec4-0129089d2fc3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.544501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7035bfa-aeb3-4dc4-9d9c-f7fff784932f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.549011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.549628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.549909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.550178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.550730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.551370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.551661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.551913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.552552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.552901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.554140 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c132-c650-47bd-aa8a-ac068d988f22 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.565864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 875/1741] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:16.566927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.567209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.567513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.590791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:16.592125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.602538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 876/1742] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:16.603723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.621077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a968-144d-4a13-9d8c-57f786d4a8ce None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.626924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.627614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.627930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.628233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] PATH_INFO: `/v3/projects/e260e462588d46178b0031c0b7730505/users/40f4a6098f3141ce93a5cd914f1b4577/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.628880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.630616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.640955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 867/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:16.643958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.644492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e260e462588d46178b0031c0b7730505, user_id=40f4a6098f3141ce93a5cd914f1b4577, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.646062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.647706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab385-bcdc-46ff-b763-1aa5e606e148 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.673945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 877/1744] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:16 2022] PUT /identity/v3/projects/e260e462588d46178b0031c0b7730505/users/40f4a6098f3141ce93a5cd914f1b4577/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:16.690456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.690683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.690954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.734512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] MFA Rules not processed for user `40f4a6098f3141ce93a5cd914f1b4577`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:16.736429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:16.760048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be26b1-8a3f-42a0-abdd-98e50ac685f4 service glance] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.822356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 878/1745] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:16.826841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:16.840167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.840888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.841167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.841435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.863469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.898820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3142c34-a056-4712-806e-9dc61332fd83 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:16.904394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:16.905135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:16.905568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:16.906173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:16.906834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.909031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.920300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:16.934359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:16.935900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:16.947997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 879/1746] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:16.948154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 868/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:16.949028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.033617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4e229-02eb-49c6-abff-deadec56f908 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.039404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.040081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.040500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.040958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.041742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.045022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.075067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 880/1748] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:16 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:17.080968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.093980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745b61-ac9c-4ecd-a453-eecdf3a7cd63 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.100034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.100951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.101292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.101632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.102479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.106283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.119318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 869/1749] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:17.122580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.149466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac5f3c-09a4-4fba-9c2e-c12bc5ba6008 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.154833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.156202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.156478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.156749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.157405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.158999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd003f97-05c7-4bdf-8e1c-327de181b1b2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.175899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 881/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:17.178606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.194920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c3ae1-a5f9-4aa1-af41-0996177eb594 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.201814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.202525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.202833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.203118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] PATH_INFO: `/v3/projects/d3089c8c17c346569dca5f07bf3114bd/users/77cee0e8cd4448a7bee90c8d1119057c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.225097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3089c8c17c346569dca5f07bf3114bd, user_id=77cee0e8cd4448a7bee90c8d1119057c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.229254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.251741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 870/1751] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:17 2022] PUT /identity/v3/projects/d3089c8c17c346569dca5f07bf3114bd/users/77cee0e8cd4448a7bee90c8d1119057c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:17.263548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.264159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.264921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.304682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.308207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.314043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] MFA Rules not processed for user `77cee0e8cd4448a7bee90c8d1119057c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:17.315269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.426217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 882/1752] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:17.426217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.428596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.443942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdae938-b848-464a-b86c-75d8887defe2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.450010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.450798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.451222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.451587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] PATH_INFO: `/v3/projects/d935e6a60b2043648eb0b97f6205dcdf` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.454349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d935e6a60b2043648eb0b97f6205dcdf)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.457042 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.458379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5321cf-d1b0-4992-aa14-711316e4e8ea None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.480713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.480886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.481099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.481368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] PATH_INFO: `/v3/users/5f95d6584e934888b656c02cea7cb41c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.483025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f95d6584e934888b656c02cea7cb41c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.485653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.532478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd935e6a60b2043648eb0b97f6205dcdf', 'request_id': 'req-2c858459-6a1d-4658-9db7-870cb29728fe'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.540317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd935e6a60b2043648eb0b97f6205dcdf', 'request_id': 'req-2c858459-6a1d-4658-9db7-870cb29728fe'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.549416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd935e6a60b2043648eb0b97f6205dcdf', 'request_id': 'req-2c858459-6a1d-4658-9db7-870cb29728fe'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.563683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f95d6584e934888b656c02cea7cb41c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.564923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f95d6584e934888b656c02cea7cb41c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.567914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] The token cache is being invalidate because project d935e6a60b2043648eb0b97f6205dcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:17.568243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.569159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.570633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:17.570978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 871/1753] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:17 2022] DELETE /identity/v3/projects/d935e6a60b2043648eb0b97f6205dcdf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:17.575799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.576634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f95d6584e934888b656c02cea7cb41c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.578212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.578362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f95d6584e934888b656c02cea7cb41c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.591571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f95d6584e934888b656c02cea7cb41c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.592823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:17.624042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 883/1754] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:17 2022] DELETE /identity/v3/users/5f95d6584e934888b656c02cea7cb41c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:17.626025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.627500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.659628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858459-6a1d-4658-9db7-870cb29728fe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.725581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffda44-5338-44b4-826a-a297f9c8cfa9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.730860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.731466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.731747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.732018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] PATH_INFO: `/v3/users/58c5a79f4ed244f6805122cf4b8640e9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.735713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c5a79f4ed244f6805122cf4b8640e9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.741503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.743211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.743867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.744786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.744786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.745104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.747803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac119570-6682-4003-800b-c59bb83ecc1c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:17.781789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 872/1755] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:17.783066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.783377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.783668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.810063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c5a79f4ed244f6805122cf4b8640e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.810833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c5a79f4ed244f6805122cf4b8640e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.813670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:17.815320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.819792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c5a79f4ed244f6805122cf4b8640e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.820759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c5a79f4ed244f6805122cf4b8640e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.830200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c5a79f4ed244f6805122cf4b8640e9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:17.856693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 884/1756] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:17 2022] DELETE /identity/v3/users/58c5a79f4ed244f6805122cf4b8640e9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:17.857600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.859101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.914828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 873/1757] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:17.927619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:17.930000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:17.933349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:17.960811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3ce9-71a8-491b-a648-fcb248352692 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:17.967061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:17.968568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:17.968959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:17.969312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:17.970154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:17.972587 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.002860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 885/1758] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:17 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:18.004190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.014478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.017815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055786-136c-427b-8b65-570799c50b11 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.023074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.024500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.024791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.025204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.026279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.028019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.031133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f148df9-f5fa-416a-ab46-af38fe7d9fcf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.040835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 886/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:18.046641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.059582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c03aa-7d66-4da1-8177-e81b601855f7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.070272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.071630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.072015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.072761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] PATH_INFO: `/v3/projects/9edede6535ed409a943fea748d1b77b0/users/07c8539f5fb9480499e85984252e931f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.096991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edede6535ed409a943fea748d1b77b0, user_id=07c8539f5fb9480499e85984252e931f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.100314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.103271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.104365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.104483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.104906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.116237 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.117815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.120435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 887/1760] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:18 2022] PUT /identity/v3/projects/9edede6535ed409a943fea748d1b77b0/users/07c8539f5fb9480499e85984252e931f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:18.121353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.129028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 874/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:18.196554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a191e-d44b-42ba-90f3-346692efd1a7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.203375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.204005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.204416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.204589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.205273 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.207202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b130c3-6f51-4efa-86c6-4687fd149dcb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.219463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 888/1762] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:18.223690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.236394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cff1c-2304-4486-9408-f2b8fa193604 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.241648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.242572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.242948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.243290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] PATH_INFO: `/v3/projects/9edede6535ed409a943fea748d1b77b0/users/07c8539f5fb9480499e85984252e931f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.245634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edede6535ed409a943fea748d1b77b0, user_id=07c8539f5fb9480499e85984252e931f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.248475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.261259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 875/1763] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:18 2022] PUT /identity/v3/projects/9edede6535ed409a943fea748d1b77b0/users/07c8539f5fb9480499e85984252e931f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:18.274084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.274396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.274640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.285842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.288445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.316618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] MFA Rules not processed for user `07c8539f5fb9480499e85984252e931f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:18.317323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.453146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83c43-2cac-49ca-a38b-6830144b3705 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.459782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.460523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.460804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.461078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] PATH_INFO: `/v3/projects/cafd190d375842358fc4b874315aba0f` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.465247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafd190d375842358fc4b874315aba0f)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.467244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.475313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 889/1764] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:18.492026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.495247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.557324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.571865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafd190d375842358fc4b874315aba0f', 'request_id': 'req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.580057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafd190d375842358fc4b874315aba0f', 'request_id': 'req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.596874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafd190d375842358fc4b874315aba0f', 'request_id': 'req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.614307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] The token cache is being invalidate because project cafd190d375842358fc4b874315aba0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:18.614587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.615261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.617267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 876/1765] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:18 2022] DELETE /identity/v3/projects/cafd190d375842358fc4b874315aba0f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:18.617952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.619319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.627631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798be5c-91a7-45a6-8c62-eeb1e5d6e1bd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.641653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.677628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.678228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.678501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.678764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.680502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.691175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc523-83a4-4821-aa13-35f0c1c2e0e9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.696134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.696785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.697091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.697364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] PATH_INFO: `/v3/projects/32d2b9ec54df4b3fbfec5c0668cf4064` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.698489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d2b9ec54df4b3fbfec5c0668cf4064)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.700851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.754273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d2b9ec54df4b3fbfec5c0668cf4064', 'request_id': 'req-c0e7845a-a00e-4f36-8c9c-6541ca339f60'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.758575 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.760068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6a94f-240a-4ace-ad5b-43eee2fb7228 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.760736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d2b9ec54df4b3fbfec5c0668cf4064', 'request_id': 'req-c0e7845a-a00e-4f36-8c9c-6541ca339f60'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.768941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d2b9ec54df4b3fbfec5c0668cf4064', 'request_id': 'req-c0e7845a-a00e-4f36-8c9c-6541ca339f60'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.770865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 890/1766] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:18.772117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.772393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.772738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.780970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] The token cache is being invalidate because project 32d2b9ec54df4b3fbfec5c0668cf4064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:18.782118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.782798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.784566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 877/1767] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:18 2022] DELETE /identity/v3/projects/32d2b9ec54df4b3fbfec5c0668cf4064 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:18.788413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.790073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.793820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:18.795257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.876827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7845a-a00e-4f36-8c9c-6541ca339f60 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.878944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 891/1768] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:18.881704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.882609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.882886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.883159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] PATH_INFO: `/v3/users/948d8dc5481547b19ffb32cf33700ca9` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.884326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948d8dc5481547b19ffb32cf33700ca9)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:18.886249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:18.887064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:18.888457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.940919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.954697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948d8dc5481547b19ffb32cf33700ca9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.955490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948d8dc5481547b19ffb32cf33700ca9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.958340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:18.966795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948d8dc5481547b19ffb32cf33700ca9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.967722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948d8dc5481547b19ffb32cf33700ca9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:18.968000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb03e99-56de-4357-a71a-82c71557ef41 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:18.971655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:18.972265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:18.972655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:18.972815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:18.974806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:18.978097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0366f8a5-4ebc-49e9-9d5e-c9adfd49fb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948d8dc5481547b19ffb32cf33700ca9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.015054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 878/1769] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:18 2022] DELETE /identity/v3/users/948d8dc5481547b19ffb32cf33700ca9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:19.016591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.016876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.017151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.054057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.055826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.058829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:19.061434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.070642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 892/1770] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:19.164490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 879/1771] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:19.168702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.183646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4afe-aec9-427b-b0e7-b4122ab6e148 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.189933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.191197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.191606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.191784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.192944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:19.193314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.195630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.219901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.228842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 893/1772] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:19.234980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9ca0-2191-406b-b8a9-74caa138a806 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.247854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.248553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.248837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.250005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.250764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.255883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.310162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.312933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 880/1773] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:19.323967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747ed1c-5eaf-4662-b223-81d1e104e673 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.400944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.403374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.422792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.423549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.423930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.424184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.424817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.427110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.456378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 894/1774] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:19.460380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.475602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e2ba-a3fd-48cb-ba6c-00c3f3244450 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.482900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.484546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.484961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.485283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.485978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.488874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.503362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 895/1775] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:19.504498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.514344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25747fd-54d1-4c32-80a4-cd306e0e6ced admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.515156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aba5c-79f0-4498-9ba5-b443f682f42a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.520351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.520786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.521547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.521547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.521900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] PATH_INFO: `/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.523156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.523299 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f0ca7d150246e6b0b2f2d8f104d0fe)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.523402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.523697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.524323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.525511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.526404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.557767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 896/1776] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:19.564279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.606227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9810bec-3fc3-404c-88e3-16788a7c1c26 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.610962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:19.613179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f0ca7d150246e6b0b2f2d8f104d0fe', 'request_id': 'req-00eea47f-4352-4403-8949-45e60be52dc9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.623213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f0ca7d150246e6b0b2f2d8f104d0fe', 'request_id': 'req-00eea47f-4352-4403-8949-45e60be52dc9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.633666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f0ca7d150246e6b0b2f2d8f104d0fe', 'request_id': 'req-00eea47f-4352-4403-8949-45e60be52dc9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.662546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] The token cache is being invalidate because project 06f0ca7d150246e6b0b2f2d8f104d0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:19.662918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.663777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-00eea47f-4352-4403-8949-45e60be52dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:19.666144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 881/1777] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:19 2022] DELETE /identity/v3/projects/06f0ca7d150246e6b0b2f2d8f104d0fe => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:19.683322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1f7d-d2fd-4d88-9525-c93d449792f2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.683322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1f7d-d2fd-4d88-9525-c93d449792f2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.683322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1f7d-d2fd-4d88-9525-c93d449792f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.720675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-72ec1f7d-d2fd-4d88-9525-c93d449792f2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:19.721895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-72ec1f7d-d2fd-4d88-9525-c93d449792f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.736115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:19.781543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.782243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.782524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.782798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] PATH_INFO: `/v3/projects/c909fee619f54ffaba6931edb14e98a6/users/edfececd4ecf47e79b1f201560d9f8ab/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.811198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 882/1778] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:19.821695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.821987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.822256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.826184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c909fee619f54ffaba6931edb14e98a6, user_id=edfececd4ecf47e79b1f201560d9f8ab, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.829313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed761aa-d0b6-4141-89e2-c3ced3df9c20 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.846997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 897/1779] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:19 2022] PUT /identity/v3/projects/c909fee619f54ffaba6931edb14e98a6/users/edfececd4ecf47e79b1f201560d9f8ab/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:19.849730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:19.851216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.860919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.861388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.861708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.897963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] MFA Rules not processed for user `edfececd4ecf47e79b1f201560d9f8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:19.899173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.937537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 883/1780] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:19.941655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.955586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06435f-46a1-455b-8eee-6454d49e8c37 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:19.961659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:19.962378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:19.962851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:19.963199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:19.963940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:19.964309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:19.965975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:19.974687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 898/1781] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:19.982691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 884/1782] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:19.984703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.991711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:19.994286 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:19.995949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507a030-f5cb-45b5-b2d8-6e70c112839e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.002250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.003104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.003659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.004031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.004606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.006564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.039320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 899/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:19 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:20.043379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.068798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802461e6-a6e2-4a01-a868-ca7ece81ac09 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.090606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:20.111355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b7b1e-d4e2-4487-907a-c340fb2b6247 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.116261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.116919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.117206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.117501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.118150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.120216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.142877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.143557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.143833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.144100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.147922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 900/1784] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:20 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:20.152807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.167066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe90d4d-1bce-457c-bf4a-d59ec9fac056 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.173627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.174285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.174555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.174822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.175513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.177569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.189999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 901/1785] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:20.194043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.207172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5e857-58fe-4ca8-9129-15543d12b262 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.217003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.219222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.219582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.219857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.220534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.222225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.224360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.225162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:20.226900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.241953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 902/1786] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:20.242841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.259536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 885/1787] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:20.259655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20344b9f-ea5d-403b-95a5-79ec813088c9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.262978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.263750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.264386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:20.264990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.265855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.265855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] PATH_INFO: `/v3/projects/b387a9426f994199b673411fab230f05/users/b346124fc1874b7c8110652c7d59456c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.284079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b387a9426f994199b673411fab230f05, user_id=b346124fc1874b7c8110652c7d59456c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.287862 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5d3f3-e41d-4e51-a6dd-0b104b5b3f2f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.294393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721576a-5f15-41a4-a3ff-77a8f8b1213a service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.301570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.302219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.302499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.302989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] PATH_INFO: `/v3/users/edfececd4ecf47e79b1f201560d9f8ab` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.304547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfececd4ecf47e79b1f201560d9f8ab)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.307270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.315379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 903/1788] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:20 2022] PUT /identity/v3/projects/b387a9426f994199b673411fab230f05/users/b346124fc1874b7c8110652c7d59456c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:20.319946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.320583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.321203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.355918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] MFA Rules not processed for user `b346124fc1874b7c8110652c7d59456c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:20.357769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:20.378835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfececd4ecf47e79b1f201560d9f8ab'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:20.379855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfececd4ecf47e79b1f201560d9f8ab'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:20.388667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfececd4ecf47e79b1f201560d9f8ab'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:20.389446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfececd4ecf47e79b1f201560d9f8ab'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:20.403937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-28a966bb-f3b7-4b68-af69-8b09bfb44c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfececd4ecf47e79b1f201560d9f8ab'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:20.434242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 886/1789] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:20 2022] DELETE /identity/v3/users/edfececd4ecf47e79b1f201560d9f8ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:20.440929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.441367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.441707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.445903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 904/1790] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:20.451672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.460527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:20.475424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:20.477062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:20.540259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:20.549202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf807-6fd3-455b-8530-f5ca8e92ce92 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.567020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 887/1791] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:20.576168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.578180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:20.640478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.641810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.642267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.643019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.643695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.646162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.662091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0246f8-2450-4455-b8ba-3c062ba680cd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.666461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.667171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.667550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.667688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:20.668004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.685569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.689494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.696674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 905/1792] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:20 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:20.697939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.713438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 888/1793] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:20.809915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3fb12-2221-4170-93f8-e3a6aad9ad09 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.830527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.831469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.831753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.832029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.832684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.834622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.883906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 906/1794] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:20 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:20.893860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.908896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522fa1-2122-4b96-b35d-42c703b80975 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.915181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.916202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.916487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.917748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:20.918720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:20.923906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:20.943721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 889/1795] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:20.947504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:20.967856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f113e6-1d29-497f-8a26-5a29c44b8047 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:20.979401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:20.980190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:20.980457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:20.980736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] PATH_INFO: `/v3/projects/2c1148a772fe4677babe11b6a2307a90/users/24ed30ae63a64554b2c808b0358330be/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.021667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1148a772fe4677babe11b6a2307a90, user_id=24ed30ae63a64554b2c808b0358330be, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.024432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.069498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 907/1796] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:20 2022] PUT /identity/v3/projects/2c1148a772fe4677babe11b6a2307a90/users/24ed30ae63a64554b2c808b0358330be/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:21.073242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.089694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5774c-ec4d-46e1-8516-f192c41e07ca admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.284755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.285441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.286023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.286023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.286537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.288211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.305335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 890/1797] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:21.306595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.320437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd19cd-d347-4f3c-a7d0-d1d006114e2f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.329234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.330151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.330494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.331068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] PATH_INFO: `/v3/projects/2c1148a772fe4677babe11b6a2307a90/users/24ed30ae63a64554b2c808b0358330be/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.333349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1148a772fe4677babe11b6a2307a90, user_id=24ed30ae63a64554b2c808b0358330be, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.343610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655f33-1de2-4e04-8d29-5ad7e7a6255d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.352698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.352796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.374149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 908/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:21 2022] PUT /identity/v3/projects/2c1148a772fe4677babe11b6a2307a90/users/24ed30ae63a64554b2c808b0358330be/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:21.377879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3662d0-b360-41de-8b58-162afbc6d41f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.386285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.390817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.404160 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.446962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] MFA Rules not processed for user `24ed30ae63a64554b2c808b0358330be`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:21.448397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.515613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.516471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.516848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.517218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] PATH_INFO: `/v3/projects/c909fee619f54ffaba6931edb14e98a6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.521018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c909fee619f54ffaba6931edb14e98a6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.521018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.544292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:21.586544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 909/1799] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:21.600356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.602746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.622950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c909fee619f54ffaba6931edb14e98a6', 'request_id': 'req-24383c5c-17b3-4fad-a068-2952dbcfc4ba'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:21.642779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c909fee619f54ffaba6931edb14e98a6', 'request_id': 'req-24383c5c-17b3-4fad-a068-2952dbcfc4ba'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:21.654623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c909fee619f54ffaba6931edb14e98a6', 'request_id': 'req-24383c5c-17b3-4fad-a068-2952dbcfc4ba'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:21.672259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] The token cache is being invalidate because project c909fee619f54ffaba6931edb14e98a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:21.672639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:21.673732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-24383c5c-17b3-4fad-a068-2952dbcfc4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:21.676110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 891/1800] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:21 2022] DELETE /identity/v3/projects/c909fee619f54ffaba6931edb14e98a6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:21.680581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf23e8f-8786-4081-822c-b169db86115c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.681191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf23e8f-8786-4081-822c-b169db86115c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.681742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf23e8f-8786-4081-822c-b169db86115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.709416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:21.717164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6bf23e8f-8786-4081-822c-b169db86115c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:21.719474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6bf23e8f-8786-4081-822c-b169db86115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.742051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598c52-9ed0-4d89-9cbb-7fee2592348d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.827091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 892/1801] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:21.829675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.831098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.831098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.855261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:21.859493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.863637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.865624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.866060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.866504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.869350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:21.871416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 893/1802] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:21.883400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.911688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e46084-ed4b-4692-925a-d404dc47f2df None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.924257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.925529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.925978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.926384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.927583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:21.928323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.930091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.945264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 894/1803] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:21.950784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:21.974446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6853a-11af-468e-9f9b-5269c0eb8efe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:21.979753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:21.980367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:21.980645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:21.980918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:21.981738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.983886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:21.998144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:21.999759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.016748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 910/1804] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:22.068141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 895/1805] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:21 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:22.072873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.093110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dd45e-efe4-4fb0-92a1-a4a7c0aff208 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:22.206281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:22.207006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.209131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.209530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.210397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:22.212498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.251844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 911/1806] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:22 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:22.253760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.265862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3e36-9449-40c3-8563-24d708feb110 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:22.274384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:22.275000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.275770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.275905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.277032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:22.278131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.289727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 896/1807] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:22.293764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.331144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c98bba-7a42-4b01-a2b5-62cdf143df7a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:22.336185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:22.336801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.337082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.337356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.338008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:22.339663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b0e2d-7e2f-4fdf-9f27-91a525573062 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.352500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 912/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:22.356326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.370150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02d5ed-be27-4fcc-a21b-8a9d9e2039cb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:22.378458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:22.378458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.378458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.378458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] PATH_INFO: `/v3/projects/7203cf45ce354a00854fd656392f0566/users/4d2fa0a0d7c2444c9ad4c121f60743a0/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.396778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7203cf45ce354a00854fd656392f0566, user_id=4d2fa0a0d7c2444c9ad4c121f60743a0, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:22.399557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.417491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 897/1809] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:22 2022] PUT /identity/v3/projects/7203cf45ce354a00854fd656392f0566/users/4d2fa0a0d7c2444c9ad4c121f60743a0/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:22.427792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.428098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.428355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.469161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] MFA Rules not processed for user `4d2fa0a0d7c2444c9ad4c121f60743a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:22.470830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:22.478955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:22.554454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 913/1810] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:22.570239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.572720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:22.613932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:22.666035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b501ab-4d27-4e04-ba34-2814800d0d2b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:22.677430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:22.678064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:22.678365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:22.678639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:22.690059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:22.691616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:22.715328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 898/1811] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:22.956924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:22.960773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.051017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:23.053086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.087712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286616c-27ff-4e0c-ba16-507c8b5b006a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:23.094238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:23.095216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.096164 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.096703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] PATH_INFO: `/v3/users/40f4a6098f3141ce93a5cd914f1b4577` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.098087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f4a6098f3141ce93a5cd914f1b4577)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:23.100528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:23.198465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d265f-7fa6-4915-88b0-2bfcefd96685 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:23.208562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:23.209227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.209508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.209839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] PATH_INFO: `/v3/users/b346124fc1874b7c8110652c7d59456c` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.211106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b346124fc1874b7c8110652c7d59456c)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:23.213392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:23.215404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f4a6098f3141ce93a5cd914f1b4577'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.216394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f4a6098f3141ce93a5cd914f1b4577'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.226781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f4a6098f3141ce93a5cd914f1b4577'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.227543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f4a6098f3141ce93a5cd914f1b4577'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.243849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-02cff091-fe22-4b64-b41b-cb053c938550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f4a6098f3141ce93a5cd914f1b4577'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.273763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 914/1812] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:22 2022] DELETE /identity/v3/users/40f4a6098f3141ce93a5cd914f1b4577 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:23.278785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.279143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.279516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.294712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b346124fc1874b7c8110652c7d59456c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.295685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b346124fc1874b7c8110652c7d59456c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.300155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:23.301513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.304648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b346124fc1874b7c8110652c7d59456c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.305308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b346124fc1874b7c8110652c7d59456c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.314949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f4e0a3a-9790-4fc2-a854-37d636ab30ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b346124fc1874b7c8110652c7d59456c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:23.328173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:23.350498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 899/1813] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:23 2022] DELETE /identity/v3/users/b346124fc1874b7c8110652c7d59456c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:23.357190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.358845 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.359579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.384115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 915/1814] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:23.385222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:23.386426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.396049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:23.397436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.449232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:23.480866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 900/1815] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:23.485692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:23.488048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:23.502670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb8f6c-8506-428e-a7a7-c0dcd1098145 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:23.603896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:23.605964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.606340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.606815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.618454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d796da-77bf-4ad6-bb79-5d3f00243c78 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:23.622462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:23.625078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:23.625078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:23.625078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:23.629748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:23.631190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:23.634412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:23.636095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:23.652145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 916/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:23.653218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 901/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:24.105987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.107602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.121608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4def-952e-41f1-b243-f0d75df63731 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.126831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.127553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.127897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.128234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] PATH_INFO: `/v3/users/45850cb145004c0e996799927e2f5a52` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.129757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45850cb145004c0e996799927e2f5a52)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.131695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.190810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45850cb145004c0e996799927e2f5a52'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.191529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45850cb145004c0e996799927e2f5a52'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.199003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45850cb145004c0e996799927e2f5a52'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.199956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45850cb145004c0e996799927e2f5a52'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.208455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45850cb145004c0e996799927e2f5a52'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.229156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:24.240536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 917/1818] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/users/45850cb145004c0e996799927e2f5a52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:24.294695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.296775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.321367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684a976-b777-49bf-a18a-1a73b166c14f service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.331018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.332636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.429365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a22cf-b182-4a68-aab6-21750443176e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.437031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.438420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.439439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.439742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] PATH_INFO: `/v3/projects/b387a9426f994199b673411fab230f05` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.441520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b387a9426f994199b673411fab230f05)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.445321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.446501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.447258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.448007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.449005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] PATH_INFO: `/v3/projects/e260e462588d46178b0031c0b7730505` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.450777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e260e462588d46178b0031c0b7730505)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.454513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.544989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e260e462588d46178b0031c0b7730505', 'request_id': 'req-6b3485a2-2292-4e06-9a6b-144a833b616d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.547601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b387a9426f994199b673411fab230f05', 'request_id': 'req-6fb30530-8927-4f02-b3ea-e75064206b4c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.560273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e260e462588d46178b0031c0b7730505', 'request_id': 'req-6b3485a2-2292-4e06-9a6b-144a833b616d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.570698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b387a9426f994199b673411fab230f05', 'request_id': 'req-6fb30530-8927-4f02-b3ea-e75064206b4c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.576974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e260e462588d46178b0031c0b7730505', 'request_id': 'req-6b3485a2-2292-4e06-9a6b-144a833b616d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.583245 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b387a9426f994199b673411fab230f05', 'request_id': 'req-6fb30530-8927-4f02-b3ea-e75064206b4c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.591125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] The token cache is being invalidate because project e260e462588d46178b0031c0b7730505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:24.591507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.592236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.594358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 902/1819] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/projects/e260e462588d46178b0031c0b7730505 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:24.597705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.597821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] The token cache is being invalidate because project b387a9426f994199b673411fab230f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:24.597821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.597821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.598091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.598397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 918/1820] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/projects/b387a9426f994199b673411fab230f05 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:24.599167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.600456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.635977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:24.674482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30530-8927-4f02-b3ea-e75064206b4c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.675755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3485a2-2292-4e06-9a6b-144a833b616d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.679152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.683391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.683391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.683391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] PATH_INFO: `/v3/users/77cee0e8cd4448a7bee90c8d1119057c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.683391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cee0e8cd4448a7bee90c8d1119057c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.683391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.684535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.685112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.685473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.685742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] PATH_INFO: `/v3/projects/f93525eca27e4da9a6f73556c1914e52` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.687539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93525eca27e4da9a6f73556c1914e52)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.689502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.719574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:24.739882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cee0e8cd4448a7bee90c8d1119057c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.740677 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cee0e8cd4448a7bee90c8d1119057c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.742565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93525eca27e4da9a6f73556c1914e52', 'request_id': 'req-3711074c-ca0b-4c4e-90ed-f18afd40766e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.748170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cee0e8cd4448a7bee90c8d1119057c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.749382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cee0e8cd4448a7bee90c8d1119057c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.751066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93525eca27e4da9a6f73556c1914e52', 'request_id': 'req-3711074c-ca0b-4c4e-90ed-f18afd40766e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.757076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ad26e02e-4c5b-48cf-9cd2-fe1955947a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cee0e8cd4448a7bee90c8d1119057c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.759467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93525eca27e4da9a6f73556c1914e52', 'request_id': 'req-3711074c-ca0b-4c4e-90ed-f18afd40766e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.773043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] The token cache is being invalidate because project f93525eca27e4da9a6f73556c1914e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:24.773334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.774015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.776168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 903/1821] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/projects/f93525eca27e4da9a6f73556c1914e52 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:24.777228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.778792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.781770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 919/1822] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/users/77cee0e8cd4448a7bee90c8d1119057c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:24.783085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acecd-e3fa-47c4-b3cd-c3a0f38c009b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.783404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acecd-e3fa-47c4-b3cd-c3a0f38c009b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.783679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acecd-e3fa-47c4-b3cd-c3a0f38c009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.810483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f99acecd-e3fa-47c4-b3cd-c3a0f38c009b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:24.812621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f99acecd-e3fa-47c4-b3cd-c3a0f38c009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.857134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711074c-ca0b-4c4e-90ed-f18afd40766e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.899382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 920/1823] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:24.903998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.904281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.904890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.923209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.923877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.924150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.924413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] PATH_INFO: `/v3/users/24ed30ae63a64554b2c808b0358330be` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.925546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ed30ae63a64554b2c808b0358330be)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.927539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.929372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:24.930050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:24.932094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:24.941538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 921/1824] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:24.951343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.964453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ea32-be1d-4de3-bd24-6d586d4fabff None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:24.973159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:24.973848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:24.974153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:24.974514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:24.975182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:24.975583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:24.977190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:24.990450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ed30ae63a64554b2c808b0358330be'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.991505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ed30ae63a64554b2c808b0358330be'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:24.994452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 922/1825] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:24.995341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:24.999477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ed30ae63a64554b2c808b0358330be'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.000239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ed30ae63a64554b2c808b0358330be'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.009802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b0e47-e6b5-4301-a0f2-8233836c7196 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.010039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ed30ae63a64554b2c808b0358330be'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.016133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.016599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.016892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.017157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.017796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.019727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.034306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 904/1826] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:24 2022] DELETE /identity/v3/users/24ed30ae63a64554b2c808b0358330be => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:25.072837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 923/1827] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:25.074356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.075983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.116278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.117999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.193763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0419c-9260-45b2-9325-e9c72b0a5cb0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.240788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197c91-5ed0-435f-81da-d40c37430c8b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.246907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.247718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.248214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.248560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] PATH_INFO: `/v3/projects/d3089c8c17c346569dca5f07bf3114bd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.250361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3089c8c17c346569dca5f07bf3114bd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.252319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.260961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:25.294344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.294986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.295267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.296113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.296893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.299428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.326386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3089c8c17c346569dca5f07bf3114bd', 'request_id': 'req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.338811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 905/1828] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:25 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:25.339945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.346236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3089c8c17c346569dca5f07bf3114bd', 'request_id': 'req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.354788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3089c8c17c346569dca5f07bf3114bd', 'request_id': 'req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.361868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8820dfc-f2b7-4fcf-a9b4-a2cb666bb27a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.368233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] The token cache is being invalidate because project d3089c8c17c346569dca5f07bf3114bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:25.368606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.369285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.371116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 924/1829] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:25 2022] DELETE /identity/v3/projects/d3089c8c17c346569dca5f07bf3114bd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:25.375514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.376853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.380072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:25.464209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.464209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.464209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.464209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.464561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b8af6-8129-48c4-b30c-8a10ba0b3a62 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.464649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.465984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.469873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.470618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.470973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.471486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] PATH_INFO: `/v3/users/07c8539f5fb9480499e85984252e931f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.473302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c8539f5fb9480499e85984252e931f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.476463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.477484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 906/1830] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:25.479049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.492130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.512670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be19ad-5047-4d4b-8c22-199e6c94f872 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.519695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.520523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.520941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.521291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] PATH_INFO: `/v3/projects/2c1148a772fe4677babe11b6a2307a90` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.522780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1148a772fe4677babe11b6a2307a90)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.525056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.540000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c8539f5fb9480499e85984252e931f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.541670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c8539f5fb9480499e85984252e931f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.558219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c8539f5fb9480499e85984252e931f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.558981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c8539f5fb9480499e85984252e931f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.569221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c8539f5fb9480499e85984252e931f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.586437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1148a772fe4677babe11b6a2307a90', 'request_id': 'req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.592221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 925/1831] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:25 2022] DELETE /identity/v3/users/07c8539f5fb9480499e85984252e931f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:25.593769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1148a772fe4677babe11b6a2307a90', 'request_id': 'req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.596027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.597524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.607764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1148a772fe4677babe11b6a2307a90', 'request_id': 'req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.620044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] The token cache is being invalidate because project 2c1148a772fe4677babe11b6a2307a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:25.620335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.621148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3acd1edd-57b6-49a1-a27c-d3e1ee41c8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:25.627502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 907/1832] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:25 2022] DELETE /identity/v3/projects/2c1148a772fe4677babe11b6a2307a90 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:25.628748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:25.630530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cd17-b6dc-4b57-b7e3-f4f24f42a6da None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.630850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cd17-b6dc-4b57-b7e3-f4f24f42a6da None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.631318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540cd17-b6dc-4b57-b7e3-f4f24f42a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.664930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6540cd17-b6dc-4b57-b7e3-f4f24f42a6da None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:25.669553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6540cd17-b6dc-4b57-b7e3-f4f24f42a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.718201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f53926-4eca-47b0-a178-303e07b62329 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.727167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.728145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.728426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.728865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.729456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.731123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.743386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 926/1833] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:25.748236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.751216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.767165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd674b2-d634-42a7-8cd4-f2350cdbe4f8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.773459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.774200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.774542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.774875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] PATH_INFO: `/v3/projects/0db274f0ac9942c1a2944744b994c0cd/users/c89fd39af2844fd292c6241453b62b21/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.777124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 908/1834] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:25.788614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.789040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.789312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.817743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db274f0ac9942c1a2944744b994c0cd, user_id=c89fd39af2844fd292c6241453b62b21, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.820465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd8892-b627-4493-ac0d-90587549ee5e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.820601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:25.822141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.843431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 909/1835] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:25.846978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 927/1836] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:25 2022] PUT /identity/v3/projects/0db274f0ac9942c1a2944744b994c0cd/users/c89fd39af2844fd292c6241453b62b21/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:25.848558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.857187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.857561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.857905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.863047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c8bb-6650-4cd9-b4a3-5bc4a4808cd4 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:25.900822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] MFA Rules not processed for user `c89fd39af2844fd292c6241453b62b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:25.902248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:25.910371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:25.962418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:25.963243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:25.963723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:25.963917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:25.964757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:25.965269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:25.966869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:25.985861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 910/1837] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:25.987174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:25.998198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1277-6c24-4d4d-a7fa-4fefc081eb94 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.008013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.009132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.009132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.009356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.009805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.011746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.030236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 928/1838] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:26.031235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.033184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.048019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd467b7e-3d7b-42b8-8096-2bfb365ff5dd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.050139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 911/1839] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:25 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:26.051015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.054190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.124798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.125519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.125937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.126270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] PATH_INFO: `/v3/projects/9edede6535ed409a943fea748d1b77b0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.127644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edede6535ed409a943fea748d1b77b0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.129769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.152454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee66cc-d50b-4913-a360-3be30f32852e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.154321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:26.160190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.161022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.161486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.161827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.183379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edede6535ed409a943fea748d1b77b0', 'request_id': 'req-491bd3c5-265a-49a0-af11-f13c72616918'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.192959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edede6535ed409a943fea748d1b77b0', 'request_id': 'req-491bd3c5-265a-49a0-af11-f13c72616918'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.199845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edede6535ed409a943fea748d1b77b0', 'request_id': 'req-491bd3c5-265a-49a0-af11-f13c72616918'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.213687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] The token cache is being invalidate because project 9edede6535ed409a943fea748d1b77b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:26.213980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.214652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.216344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 929/1840] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:26 2022] DELETE /identity/v3/projects/9edede6535ed409a943fea748d1b77b0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:26.217173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.219160 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.240588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.243001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd408d-67c9-4711-b0d3-a72c10b73e51 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.278677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 912/1841] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:26.282738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c66-9bb9-4b5f-ae16-122aacceb1f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.283756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c66-9bb9-4b5f-ae16-122aacceb1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.284112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c66-9bb9-4b5f-ae16-122aacceb1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.307848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd3c5-265a-49a0-af11-f13c72616918 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.311826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.312787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.312930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.314158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.314328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.316757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.333529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-03815c66-9bb9-4b5f-ae16-122aacceb1f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:26.335091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-03815c66-9bb9-4b5f-ae16-122aacceb1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.350071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 913/1842] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:26.361454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.361944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.362285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.375002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 930/1843] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:26.376079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.388067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a581872-9de6-471f-bf66-d9e72a4d5f90 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.393585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.394312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.394678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.395056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.397900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.403356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.406203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:26.409374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.417917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 931/1844] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:26.418939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 914/1845] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:26.421887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.424201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.433774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08201688-6d6b-41d9-a62a-1fed882f9959 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.434717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da684f5e-5bbe-4d13-a0eb-6f9bd850c2a2 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.442579 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.443588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.444002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.444248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.444978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.446621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.458407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.459031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.459358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.459622 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.460307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:26.460607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.462239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.475864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 932/1846] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:26.476842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.478109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 915/1847] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:26.482376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.488486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79c893-fda4-4761-b24b-7c5d8169701e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.493997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270828-7e32-4131-b56e-dd6deed6c391 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.499534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.500129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.500403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.500670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.501291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.504620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.508311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.509136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.509585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.509860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] PATH_INFO: `/v3/projects/fac00f7fc8324a7dab2c22e50773f109/users/c1bc5688ed7c4087aac6b17d0c4f57c5/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.516399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:26.529294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac00f7fc8324a7dab2c22e50773f109, user_id=c1bc5688ed7c4087aac6b17d0c4f57c5, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.532332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.539012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 916/1848] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:26.540238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.565983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 933/1849] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:26 2022] PUT /identity/v3/projects/fac00f7fc8324a7dab2c22e50773f109/users/c1bc5688ed7c4087aac6b17d0c4f57c5/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:26.566830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.568505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.622094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22155b0c-48e6-4b59-8b97-ff00f828bab2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.631457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:26.663015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7ee91-7cab-4bbe-96f0-4cbf3a18b537 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.668415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.669054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.669333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.669614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] PATH_INFO: `/v3/users/c89fd39af2844fd292c6241453b62b21` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.670974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89fd39af2844fd292c6241453b62b21)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.673001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.700251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.700867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.701141 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.701439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.703111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.705089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a70dd-3921-466b-8004-298e48b3cb1d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.729054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 917/1850] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:26.730360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d340a4-fed9-4b28-8ff0-ef64cb997dd5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.730626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d340a4-fed9-4b28-8ff0-ef64cb997dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.730892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d340a4-fed9-4b28-8ff0-ef64cb997dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.738952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89fd39af2844fd292c6241453b62b21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.740683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89fd39af2844fd292c6241453b62b21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.751872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89fd39af2844fd292c6241453b62b21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.752637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89fd39af2844fd292c6241453b62b21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.759817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89fd39af2844fd292c6241453b62b21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:26.778386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 934/1851] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:26 2022] DELETE /identity/v3/users/c89fd39af2844fd292c6241453b62b21 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:26.779544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e2d340a4-fed9-4b28-8ff0-ef64cb997dd5 None None] MFA Rules not processed for user `c1bc5688ed7c4087aac6b17d0c4f57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:26.780972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e2d340a4-fed9-4b28-8ff0-ef64cb997dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.782457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.785045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.854063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255a8e-cddb-4cc5-8f59-84f72c1df357 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.859468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 918/1852] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:26.859755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.859944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.860218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.864299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.864869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.865148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.865417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.866074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.867707 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.879721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 935/1853] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:26.880652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.881195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:26.882468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.882578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.890337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 919/1854] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:26.892146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.902119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed03d03-a46b-488e-a86e-436b6b3f60f7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.907491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.908084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.908356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.908647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.909282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.911374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.917143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:26.926345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 920/1855] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:26.927354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.929335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:26.943719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778627c-cdd2-4b6c-b51d-5b6a956e4a17 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.947476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.948145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.948512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.948779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.957662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:26.959092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:26.968383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 936/1856] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:26.969139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:26.980584 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b55de-ccdd-482f-89cc-a8f6fa09ef28 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.988781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.989537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92dfb-33cd-4d3c-bca5-1dc1bac382ea admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:26.989651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.989944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.990276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] PATH_INFO: `/v3/projects/48c57a1bd36d40ec925d9e854823784e/users/749e671bf94d480c899773a927ae4a55/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:26.993463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:26.993629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:26.994268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:26.994602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:26.994809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.004484 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.005916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.008725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c57a1bd36d40ec925d9e854823784e, user_id=749e671bf94d480c899773a927ae4a55, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.011795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed918-99de-4500-b210-578884a2d98a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.015553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 921/1857] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:27.016410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.017628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.027538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 937/1858] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:26 2022] PUT /identity/v3/projects/48c57a1bd36d40ec925d9e854823784e/users/749e671bf94d480c899773a927ae4a55/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:27.030668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633b8e-5d41-4c2c-b670-3ef0dceba50f service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.039312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.039693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.039988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.076686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] MFA Rules not processed for user `749e671bf94d480c899773a927ae4a55`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:27.078173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.102772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.103721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.104103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.104879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] PATH_INFO: `/v3/users/c1bc5688ed7c4087aac6b17d0c4f57c5` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.106267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bc5688ed7c4087aac6b17d0c4f57c5)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.109952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.154094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 938/1859] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:27.165090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bc5688ed7c4087aac6b17d0c4f57c5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.165823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bc5688ed7c4087aac6b17d0c4f57c5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.168560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.170067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.173555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bc5688ed7c4087aac6b17d0c4f57c5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.174681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bc5688ed7c4087aac6b17d0c4f57c5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.183104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3de03a41-47b6-43ef-a858-cf6872a844e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bc5688ed7c4087aac6b17d0c4f57c5'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.207374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 922/1860] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:27 2022] DELETE /identity/v3/users/c1bc5688ed7c4087aac6b17d0c4f57c5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:27.210739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.211156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.211684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.238937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:27.239654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.243334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d9e-a7b8-4faf-9840-daff988ff667 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.258343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:27.305221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.306032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.306528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.307091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.309722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.320150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 923/1861] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:27.331006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.333162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.374027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:27.399955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.401552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.414100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 939/1862] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:27.414459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06782-cfb9-447a-a987-8166731b38f0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.415066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.416748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.418954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.419663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.420007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.420394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.431044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c934b-6f3c-4ee3-ad31-ba053a7c86f7 service glance] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.431944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.433847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf35223-2170-4c57-bc37-5a18cfd09970 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.440305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.440988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.441275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.441564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] PATH_INFO: `/v3/projects/0db274f0ac9942c1a2944744b994c0cd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.443074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db274f0ac9942c1a2944744b994c0cd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.445629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.445753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 924/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:27.515064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db274f0ac9942c1a2944744b994c0cd', 'request_id': 'req-7dfd732f-6763-49e8-ad88-39992195b014'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.524602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db274f0ac9942c1a2944744b994c0cd', 'request_id': 'req-7dfd732f-6763-49e8-ad88-39992195b014'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.533333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db274f0ac9942c1a2944744b994c0cd', 'request_id': 'req-7dfd732f-6763-49e8-ad88-39992195b014'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.547485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] The token cache is being invalidate because project 0db274f0ac9942c1a2944744b994c0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:27.547884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.548792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7dfd732f-6763-49e8-ad88-39992195b014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.550757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 940/1864] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:27 2022] DELETE /identity/v3/projects/0db274f0ac9942c1a2944744b994c0cd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:27.556467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.557190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.557604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.586704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:27.588176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.674201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 925/1865] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:27.691877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.692203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.692429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.718231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:27.719519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.731332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 941/1866] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:27.734332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.748486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef151-2764-47d4-ba10-0b63f1bb5ce9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.754101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.754710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.754989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.755389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.756332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:27.756332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.757874 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.776194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 926/1867] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:27.779175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.806441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb53b-3cf6-4e3e-89ac-1a6e32c77202 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.816432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.817038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.817038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.817730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.818383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.821149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.826799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.830640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:27.863893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676a7e-71fc-4ed7-9c6d-48779168a3fb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:27.871870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:27.872510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:27.872786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:27.873054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] PATH_INFO: `/v3/projects/fac00f7fc8324a7dab2c22e50773f109` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:27.874295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac00f7fc8324a7dab2c22e50773f109)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:27.876486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:27.879638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 942/1868] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:27.882678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:27.956297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:27.958604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac00f7fc8324a7dab2c22e50773f109', 'request_id': 'req-2dc2dbf3-9457-45ab-8443-459d5355ff0d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.969856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac00f7fc8324a7dab2c22e50773f109', 'request_id': 'req-2dc2dbf3-9457-45ab-8443-459d5355ff0d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:27.980409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac00f7fc8324a7dab2c22e50773f109', 'request_id': 'req-2dc2dbf3-9457-45ab-8443-459d5355ff0d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.001040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] The token cache is being invalidate because project fac00f7fc8324a7dab2c22e50773f109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:28.001477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.002331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.015566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 927/1869] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:27 2022] DELETE /identity/v3/projects/fac00f7fc8324a7dab2c22e50773f109 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:28.048577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc6c3-3f09-4a61-9fbc-ab9d42bbc417 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.119526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:28.139930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.140897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.141281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.141620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.142338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.144398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.168760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 943/1870] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:27 2022] POST /identity/v3/users => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:28.172971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.174395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.187899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2dbf3-9457-45ab-8443-459d5355ff0d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.192747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.193371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.193648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.193914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.194566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.196221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.211159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 928/1871] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:28.212389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.223543 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac013abd-e777-470a-8702-077429d300d4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.228084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.228683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.228937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.229200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.229832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.231429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87d713-74c0-4c51-ad8e-92236d264656 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.241319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 944/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:28.245480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.256012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992c0a-05a5-4c2b-a52a-5089cc2e45a6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.260960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.261705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.261991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.262402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] PATH_INFO: `/v3/projects/2764ebab66124a29927381756dc7ca42/users/d4c6fc802da64b90a14a2b8ff069cf00/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.278056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2764ebab66124a29927381756dc7ca42, user_id=d4c6fc802da64b90a14a2b8ff069cf00, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.281294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.294346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 929/1873] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:28 2022] PUT /identity/v3/projects/2764ebab66124a29927381756dc7ca42/users/d4c6fc802da64b90a14a2b8ff069cf00/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:28.304509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.304860 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.305249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.335788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] MFA Rules not processed for user `d4c6fc802da64b90a14a2b8ff069cf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:28.336996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.423493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 945/1874] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:28.424677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.491120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f946-5fb0-4d08-ae52-77ab702f1d10 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.495942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.496548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.496840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.497107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.497733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.500173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.527761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 930/1875] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:28 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:28.531845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.542616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e2f3c-5ac5-4143-bc52-f485a34976b8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.600982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.601594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.601875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.602148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.602789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.604738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.625954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 946/1876] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:28 2022] POST /identity/v3/users => generated 307 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:28.629911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.641078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce72e-1118-4eac-9d31-283b29b1500b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.647550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.648194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.648502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.648772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.649446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.651163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.664219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 931/1877] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:28.674256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.685742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6db68-5190-44fb-afeb-aabe864e9a88 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.690473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.691134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.691439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.691799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] PATH_INFO: `/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9/users/225b6a52f6664799b3d59575f11db0a7/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.708276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf3394c49c456f93b2058b1ae0b2c9, user_id=225b6a52f6664799b3d59575f11db0a7, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.711188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.716294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.718889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.725257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 947/1878] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:28 2022] PUT /identity/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9/users/225b6a52f6664799b3d59575f11db0a7/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:28.729135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.731858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005056-dcf2-4417-b537-2c264f5156ac admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.751217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:28.793157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.793779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.794052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.794316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] PATH_INFO: `/v3/users/4d2fa0a0d7c2444c9ad4c121f60743a0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.795979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2fa0a0d7c2444c9ad4c121f60743a0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.797888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.798390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959be86-a07f-4952-8f9d-c71bd7aa368e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.803417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.804040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.804318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.804589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.805263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.806880 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.814610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:28.819443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 948/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:28.824705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.837478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dccc58-3429-4be1-a7fb-b56bdebaffbf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:28.843350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:28.844207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.844471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.844768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] PATH_INFO: `/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9/users/225b6a52f6664799b3d59575f11db0a7/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.846683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf3394c49c456f93b2058b1ae0b2c9, user_id=225b6a52f6664799b3d59575f11db0a7, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:28.849551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ede31-e08c-4884-9f64-bbc04229c1a6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:28.854535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2fa0a0d7c2444c9ad4c121f60743a0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.855190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2fa0a0d7c2444c9ad4c121f60743a0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.869945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 949/1880] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:28 2022] PUT /identity/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9/users/225b6a52f6664799b3d59575f11db0a7/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:28.870148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2fa0a0d7c2444c9ad4c121f60743a0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.870148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2fa0a0d7c2444c9ad4c121f60743a0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.872820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.873296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.873847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.877432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a5cc608e-dcde-4966-b306-e7d93429f904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2fa0a0d7c2444c9ad4c121f60743a0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:28.897087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 932/1881] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:28 2022] DELETE /identity/v3/users/4d2fa0a0d7c2444c9ad4c121f60743a0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:28.901523 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94716c-5e00-46de-862b-062ba2697959 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:28.901806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94716c-5e00-46de-862b-062ba2697959 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:28.902078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94716c-5e00-46de-862b-062ba2697959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:28.906356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] MFA Rules not processed for user `225b6a52f6664799b3d59575f11db0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:28.907593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.922252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-be94716c-5e00-46de-862b-062ba2697959 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:28.923462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-be94716c-5e00-46de-862b-062ba2697959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.984038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 950/1882] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:28.985190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 933/1883] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:28.994647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94716c-5e00-46de-862b-062ba2697959 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.994798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:28.996081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:28.996221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-be94716c-5e00-46de-862b-062ba2697959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.072188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94716c-5e00-46de-862b-062ba2697959 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.082987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.083655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.083931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.084199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.090433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4a52f-6dd4-4371-ba61-9ae1d549bd7b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.094474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.095428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.095845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.096205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.101118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.102847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.108408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.110004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacdfbd-be64-4fb7-9a73-a1390a101293 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.129164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 934/1884] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:29.132407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 951/1885] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:29.286719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.288288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.306602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e547d6-08b0-40ca-9f69-fb82354e8f0a service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.312063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.312886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.313108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.313367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] PATH_INFO: `/v3/users/d4c6fc802da64b90a14a2b8ff069cf00` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.314553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c6fc802da64b90a14a2b8ff069cf00)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.316500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.358368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:29.375800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c6fc802da64b90a14a2b8ff069cf00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.376433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c6fc802da64b90a14a2b8ff069cf00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.383902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c6fc802da64b90a14a2b8ff069cf00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.384531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c6fc802da64b90a14a2b8ff069cf00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.396146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c6fc802da64b90a14a2b8ff069cf00'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.425546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 935/1886] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:29 2022] DELETE /identity/v3/users/d4c6fc802da64b90a14a2b8ff069cf00 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:29.430752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.431186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.431310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.454501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:29.456000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.487139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:29.502389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.503886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.541265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 952/1887] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:29.552449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.554006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.585769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2590a-332a-46b5-9abe-9cd201b79c0f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.591410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.592044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.592938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.593284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] PATH_INFO: `/v3/projects/7203cf45ce354a00854fd656392f0566` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.594438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7203cf45ce354a00854fd656392f0566)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.596397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.619856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0e31b-736a-4882-be89-c4c5896c4704 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.623490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.624216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.624489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.624759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.638671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.640668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284bcf5-7386-439b-b17b-81fdffd021e1 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.651062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 953/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:29.658324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7203cf45ce354a00854fd656392f0566', 'request_id': 'req-40ec692b-c308-46fb-9e3b-3383136cd574'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.664864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7203cf45ce354a00854fd656392f0566', 'request_id': 'req-40ec692b-c308-46fb-9e3b-3383136cd574'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.672572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7203cf45ce354a00854fd656392f0566', 'request_id': 'req-40ec692b-c308-46fb-9e3b-3383136cd574'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.690430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] The token cache is being invalidate because project 7203cf45ce354a00854fd656392f0566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:29.690745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.691607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-40ec692b-c308-46fb-9e3b-3383136cd574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:29.693416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 936/1889] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:29 2022] DELETE /identity/v3/projects/7203cf45ce354a00854fd656392f0566 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:29.699666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.700063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.700400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.723573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:29.724879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.786330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 954/1890] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:29.793832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.794113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.794422 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.822093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:29.824581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.835383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 937/1891] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:29.837017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.848065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e205-bd6f-43f8-8da2-c82f23f83e12 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.853003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.854404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.854404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.854404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.854883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:29.855196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.856871 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.873929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 955/1892] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:29.875633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.884930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ddeb3-fa6a-4717-a85c-e2056bf7e400 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.890107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:29.890833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:29.891176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:29.891544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:29.892289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:29.894289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:29.929477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 938/1893] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:29 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:29.930894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.940952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:29.942912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:29.944260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d4638-5044-43e8-b2bd-aba4ba7000aa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:29.959401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:30.017750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.018272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.018551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.018820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.019480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.021010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf862eb-0271-4d5f-ac90-f38b992d7289 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.021404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.026421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.027038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.027265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.027691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] PATH_INFO: `/v3/projects/2764ebab66124a29927381756dc7ca42` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.028835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2764ebab66124a29927381756dc7ca42)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.031501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:30.032084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.043573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 956/1894] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:29 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:30.052630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.064056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d61e2-3359-4639-93cc-704069c2fe11 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.069323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.069991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.070286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.070647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.071366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.073096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.089365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 957/1895] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:30.090278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.094023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2764ebab66124a29927381756dc7ca42', 'request_id': 'req-d2ebafeb-d908-4690-afb9-10a74513fd1f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.100398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2764ebab66124a29927381756dc7ca42', 'request_id': 'req-d2ebafeb-d908-4690-afb9-10a74513fd1f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.101117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b341d-9d6c-47ac-8c3b-ea89cde0bab0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.108881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2764ebab66124a29927381756dc7ca42', 'request_id': 'req-d2ebafeb-d908-4690-afb9-10a74513fd1f'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.120165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] The token cache is being invalidate because project 2764ebab66124a29927381756dc7ca42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:30.120454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.121100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.122624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 939/1896] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:29 2022] DELETE /identity/v3/projects/2764ebab66124a29927381756dc7ca42 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:30.126694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.128024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:30.164497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.165279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.165611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.166678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.167357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.168928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.187377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 958/1897] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:30.191094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.192818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:30.198129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebafeb-d908-4690-afb9-10a74513fd1f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.203458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.204072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.204378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.204613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] PATH_INFO: `/v3/users/225b6a52f6664799b3d59575f11db0a7` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.206412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26863-f1a2-4676-b460-b5bd447ab86b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.207928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225b6a52f6664799b3d59575f11db0a7)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.210930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.211788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.212953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.213376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.213684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] PATH_INFO: `/v3/projects/0f140583d4954c32898e73f2c3d95e8d/users/c4b964bfee2345b1a929e752860c459c/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.241527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f140583d4954c32898e73f2c3d95e8d, user_id=c4b964bfee2345b1a929e752860c459c, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.244773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3db3ad-c534-4fd4-b02e-37f18110eb62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.259111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 959/1898] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:30 2022] PUT /identity/v3/projects/0f140583d4954c32898e73f2c3d95e8d/users/c4b964bfee2345b1a929e752860c459c/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:30.264103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.264794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:30.265026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.265298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.268253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225b6a52f6664799b3d59575f11db0a7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.269209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225b6a52f6664799b3d59575f11db0a7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.282080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225b6a52f6664799b3d59575f11db0a7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.282811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225b6a52f6664799b3d59575f11db0a7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.287157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:30.288525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:30.290762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225b6a52f6664799b3d59575f11db0a7'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.314300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 940/1899] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:30 2022] DELETE /identity/v3/users/225b6a52f6664799b3d59575f11db0a7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:30.359644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 960/1900] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:30.366354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.367798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:30.427613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d83a0-ec2d-467c-9a72-ffd084504ff7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.431608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.432307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.432742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.433688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.517553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.519135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8e672-4376-4117-ac8f-2ebc3053b382 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.532485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 941/1901] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:30.797708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:30.799241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:30.816545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cfa1d-1025-4d8d-9a49-577248bab6d8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:30.822437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:30.823416 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.823699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.823964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] PATH_INFO: `/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.825193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebf3394c49c456f93b2058b1ae0b2c9)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:30.840889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:30.918195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:30.919822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebf3394c49c456f93b2058b1ae0b2c9', 'request_id': 'req-77252bda-b1d0-4054-89ac-8031ed36770f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.933253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebf3394c49c456f93b2058b1ae0b2c9', 'request_id': 'req-77252bda-b1d0-4054-89ac-8031ed36770f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.943040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebf3394c49c456f93b2058b1ae0b2c9', 'request_id': 'req-77252bda-b1d0-4054-89ac-8031ed36770f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.955527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] The token cache is being invalidate because project 3ebf3394c49c456f93b2058b1ae0b2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:30.956162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.956755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-77252bda-b1d0-4054-89ac-8031ed36770f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:30.961737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 961/1902] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:30 2022] DELETE /identity/v3/projects/3ebf3394c49c456f93b2058b1ae0b2c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:30.963370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:30.963651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:30.963915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:30.985690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:30.986896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:31.062216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 942/1903] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:31.071159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.071697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.071969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.097529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:31.099856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:31.109362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 962/1904] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:31.113868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.126340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c94b6-cd35-4b0a-affe-d3cdd76755ca None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.134326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.135048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.135578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.135914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.136779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:31.137289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.142346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.149061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:31.157075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 943/1905] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:31.161731 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.172558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b5608-bacb-4fa8-9ce2-70fec59d436b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.178502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.179115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.179424 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.179699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.180344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.182255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.215318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 963/1906] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:31.219939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.231958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1042d6-f689-4482-bb3a-19ec68dc38aa admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.298105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.298720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.298997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.299271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.299950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.301932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02e340-a78c-44b0-a233-89e2450a92e5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.324476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 944/1907] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:31.329673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.344148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c922b18-bb9c-4c63-92aa-ed3d8ffdb9d9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.349819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.350469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.350746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.351035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.351766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.353432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.362380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.362668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.362943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.367398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 964/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:31.368689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.379750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adccdb-f3b7-4638-b9c3-bcb93ee4132b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.384533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.385317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.385584 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.385853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.386488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.388101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.397217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] MFA Rules not processed for user `c4b964bfee2345b1a929e752860c459c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:31.399005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:31.402614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 965/1909] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:31.408166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.420120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a77d-8e4c-472b-aaa6-ed8f78ec5130 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.425170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.426025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.426420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.426697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] PATH_INFO: `/v3/projects/359b265c297a47ffb042b4f690224901/users/65002fba9b7048089e79463743154ae2/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.446494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359b265c297a47ffb042b4f690224901, user_id=65002fba9b7048089e79463743154ae2, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.450374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aecaed-0c89-41cb-85a0-0dd3d41d4fe4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.466428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 966/1910] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:31 2022] PUT /identity/v3/projects/359b265c297a47ffb042b4f690224901/users/65002fba9b7048089e79463743154ae2/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:31.477115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92913e2-5966-4955-b860-40969112c67f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.479310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 945/1911] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:31.479776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92913e2-5966-4955-b860-40969112c67f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.479776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92913e2-5966-4955-b860-40969112c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.500700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.502761 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:31.515588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c92913e2-5966-4955-b860-40969112c67f None None] MFA Rules not processed for user `65002fba9b7048089e79463743154ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:31.516925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c92913e2-5966-4955-b860-40969112c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:31.606303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcfc96-de2a-432a-85ab-976f95bb235c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.643444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:31.666196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.666895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.667567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.667567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.673084 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 967/1912] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:31.677153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92913e2-5966-4955-b860-40969112c67f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.735892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.737324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.746040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 946/1913] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:31.747751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:31.768442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92913e2-5966-4955-b860-40969112c67f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.773778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.774385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.774690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.774948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.775759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.777636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.808645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 968/1914] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:31.813579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.824020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49122fe-b18a-47e8-a4c4-8c636b6233d6 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.884219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.884829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.885107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.885379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.886054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.887967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.910579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 947/1915] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:31 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:31.914551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.925717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d075eb-dfb5-490e-8676-8b743b3a7e98 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.931172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.931807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.932090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.932364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.933011 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.934586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:31.944754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 969/1916] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:31.949081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:31.960941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a201ee-347f-469a-a41b-390beee7bf1e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:31.965569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:31.966229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:31.966487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:31.966753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] PATH_INFO: `/v3/projects/652e532e965946d0a84a12e0418aff81/users/539c1583eb384e48aa62d56c710556cb/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:31.984676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=652e532e965946d0a84a12e0418aff81, user_id=539c1583eb384e48aa62d56c710556cb, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:31.990680 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:32.017064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 948/1917] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:31 2022] PUT /identity/v3/projects/652e532e965946d0a84a12e0418aff81/users/539c1583eb384e48aa62d56c710556cb/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:32.020973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:32.032008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78fed-5534-4d5e-85fc-0e19d8b8d6bf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:32.112595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:32.113210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:32.113480 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:32.113813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:32.114488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:32.116100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb55ee-aacd-4dee-947c-0220ce168945 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:32.126178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 970/1918] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:32.130378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:32.140743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df192d5-72b1-4874-827e-207bedbd0cdd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:32.145312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:32.145954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:32.146232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:32.146503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] PATH_INFO: `/v3/projects/652e532e965946d0a84a12e0418aff81/users/539c1583eb384e48aa62d56c710556cb/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:32.148407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652e532e965946d0a84a12e0418aff81, user_id=539c1583eb384e48aa62d56c710556cb, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:32.151034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:32.162164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 949/1919] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:32 2022] PUT /identity/v3/projects/652e532e965946d0a84a12e0418aff81/users/539c1583eb384e48aa62d56c710556cb/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:32.174155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2963-9668-4a03-b41a-f8fd95ff2510 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:32.174441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2963-9668-4a03-b41a-f8fd95ff2510 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:32.174770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2963-9668-4a03-b41a-f8fd95ff2510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:32.202059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-571c2963-9668-4a03-b41a-f8fd95ff2510 None None] MFA Rules not processed for user `539c1583eb384e48aa62d56c710556cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:32.203163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-571c2963-9668-4a03-b41a-f8fd95ff2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:32.271852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 971/1920] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:32.284015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:32.285921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:32.329548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:32.345222 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c4b21-7123-4284-be0c-7293cb137555 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:32.348730 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:32.349322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:32.349594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:32.349858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:32.403883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:32.405831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:32.414474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 950/1921] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:33.132594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:33.133091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:33.133091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:33.153659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] MFA Rules not processed for user `c4b964bfee2345b1a929e752860c459c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:33.154924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:33.198257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:33.213904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 972/1922] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:33.803364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:33.814926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513089d7-b04e-4afb-89b8-0c9aa21b81bc service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:33.828832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:33.829544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:33.829800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:33.831356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:33.843681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:33.845177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81392800-4a3e-4cf1-8c5a-aed5a3e6291e service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:33.856823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 951/1923] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:37.792025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:37.854266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588df0-3959-4613-ae37-4a6e95478f3e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:37.858761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:37.859586 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:37.859737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:37.860044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] PATH_INFO: `/v3/users/65002fba9b7048089e79463743154ae2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:37.861173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65002fba9b7048089e79463743154ae2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:37.863300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:37.910733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65002fba9b7048089e79463743154ae2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:37.911404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65002fba9b7048089e79463743154ae2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:37.918256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65002fba9b7048089e79463743154ae2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:37.918869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65002fba9b7048089e79463743154ae2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:37.926033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65002fba9b7048089e79463743154ae2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:37.943463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 973/1924] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:37 2022] DELETE /identity/v3/users/65002fba9b7048089e79463743154ae2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:37.947962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:37.948460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:37.948550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:37.969935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:37.971531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:38.031371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 952/1925] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:38.041073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:38.042521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:38.103404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de5ac2-b28b-4935-bf17-f86d73127465 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:38.107072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:38.108320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:38.108540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:38.108808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:38.117767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:38.119175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:38.128488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 974/1926] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:38.412573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:38.414227 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:38.427777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fc88c-143f-4f52-aba2-afaed9bcd7cf None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:38.433027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:38.433825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:38.434407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:38.434510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] PATH_INFO: `/v3/projects/359b265c297a47ffb042b4f690224901` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:38.436613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=359b265c297a47ffb042b4f690224901)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:38.439169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:38.503601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359b265c297a47ffb042b4f690224901', 'request_id': 'req-05d4e90d-49bf-4831-93b1-d5a233ffbadf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.510599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359b265c297a47ffb042b4f690224901', 'request_id': 'req-05d4e90d-49bf-4831-93b1-d5a233ffbadf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.519629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359b265c297a47ffb042b4f690224901', 'request_id': 'req-05d4e90d-49bf-4831-93b1-d5a233ffbadf'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.531547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] The token cache is being invalidate because project 359b265c297a47ffb042b4f690224901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:38.531970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.532699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.534294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 953/1927] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:38 2022] DELETE /identity/v3/projects/359b265c297a47ffb042b4f690224901 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:38.538596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:38.549983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcd20f-fbb8-4ff3-a96c-d64890fa3b2b service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:38.570115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:38.659632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:38.660841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:38.662120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:38.662494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] PATH_INFO: `/v3/users/539c1583eb384e48aa62d56c710556cb` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:38.664081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=539c1583eb384e48aa62d56c710556cb)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:38.666334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:38.765674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539c1583eb384e48aa62d56c710556cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.767180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539c1583eb384e48aa62d56c710556cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.776535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539c1583eb384e48aa62d56c710556cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.777213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539c1583eb384e48aa62d56c710556cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.788883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-588b7f8c-b839-4840-a353-6a664834b3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539c1583eb384e48aa62d56c710556cb'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:38.814501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 975/1928] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:38 2022] DELETE /identity/v3/users/539c1583eb384e48aa62d56c710556cb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:39.204104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.205900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:39.216444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:39.222272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e90d-49bf-4831-93b1-d5a233ffbadf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.285252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.285900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.286173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.286423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] PATH_INFO: `/v3/projects/652e532e965946d0a84a12e0418aff81` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.287562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=652e532e965946d0a84a12e0418aff81)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.289467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.337664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652e532e965946d0a84a12e0418aff81', 'request_id': 'req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:39.344856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652e532e965946d0a84a12e0418aff81', 'request_id': 'req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:39.353797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652e532e965946d0a84a12e0418aff81', 'request_id': 'req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:39.364763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] The token cache is being invalidate because project 652e532e965946d0a84a12e0418aff81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:39.365048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:39.365669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0b0a7a30-8f6c-44ec-acf6-a71a7df6a4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:39.367170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 954/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:39 2022] DELETE /identity/v3/projects/652e532e965946d0a84a12e0418aff81 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:39.372180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.372463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.372731 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.392626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:39.393804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:39.456752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 976/1930] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:39.464220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.464502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.464772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.484783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:39.486109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:39.496067 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 955/1931] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:39.501734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.511549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700d64e-f037-4cb4-bdab-285b7a5fcee2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.516249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.516841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.517117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.517382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.518022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:39.518318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.519939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.531269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 977/1932] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:39.535637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.545439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bd2f7-58f8-41d7-b110-71e414d985cc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.550102 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.550693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.550972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.551246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.551940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.553844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.585521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 956/1933] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:39.589654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.600511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c527d-8954-4f48-8256-8e824f663f16 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.617627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:39.658952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.659614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.659889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.660156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.660855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.662968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.690509 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 978/1934] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:39.691973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.702810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52390eb2-416a-4a10-a3f1-cda23acb4938 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.707944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.708475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.708752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.709359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.709725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.711326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.723986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 957/1935] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:39.728249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.744301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11dcf1-58be-4476-b791-c24efcddaf9c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.749612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.750941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.750941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.750941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.751398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.753213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96089a2d-a226-4b64-a738-271f5ccc539c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.768165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 979/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:39.772105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.787124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee0ce-b966-4504-ae30-5f6b75b0d47f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:39.795566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:39.796239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.796509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.796773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] PATH_INFO: `/v3/projects/b3edcdf06fe64a3f9613e3f686752c45/users/2458092f834c4d0fa005643cb33017d0/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.812912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3edcdf06fe64a3f9613e3f686752c45, user_id=2458092f834c4d0fa005643cb33017d0, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:39.820053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:39.860106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 958/1937] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:39 2022] PUT /identity/v3/projects/b3edcdf06fe64a3f9613e3f686752c45/users/2458092f834c4d0fa005643cb33017d0/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:39.860204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:39.860204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:39.860204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:39.886270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] MFA Rules not processed for user `2458092f834c4d0fa005643cb33017d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:39.887567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:39.960222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 980/1938] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:39.964799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:39.999592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:40.033491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736861a-0adb-4e32-b5bb-a3db27dad97f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.038751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.039456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.039762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.039962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.040693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.042609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.078481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 959/1939] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:39 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:40.085572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.102938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f1160-194c-4016-89d5-b871516dc296 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.188266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.188889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.189170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.189450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.190088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.192067 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.218166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 981/1940] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:40 2022] POST /identity/v3/users => generated 311 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:40.222331 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.233699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7ef1b-0171-4db6-a437-348f48449e60 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.239334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.240212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.240579 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.240997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.242071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.243936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.256852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 960/1941] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:40.261276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.271792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f4d4b-3063-4b50-baf8-a554d03fca4d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.276401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.277042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.277319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.277590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] PATH_INFO: `/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f/users/ece5b01465a24e068bb255ce589fe9f8/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.292647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22b93fdbcd64f488d95ae77ea2a169f, user_id=ece5b01465a24e068bb255ce589fe9f8, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.295886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.298009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:40.309692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 982/1942] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:40 2022] PUT /identity/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f/users/ece5b01465a24e068bb255ce589fe9f8/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:40.314256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.324238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277d36-c5d4-4f74-bf93-3a2470d47105 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.382126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.382727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.383006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.383297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.383938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.385540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bebcb-c8b9-43f6-9fc8-7ccddac87689 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.395687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 961/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:40.400371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.411431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea3599-4989-4e8c-8ef7-60270c47cf5c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.416006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.416645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.416919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.417185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] PATH_INFO: `/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f/users/ece5b01465a24e068bb255ce589fe9f8/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.419071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22b93fdbcd64f488d95ae77ea2a169f, user_id=ece5b01465a24e068bb255ce589fe9f8, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.422303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.432306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 983/1944] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:40 2022] PUT /identity/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f/users/ece5b01465a24e068bb255ce589fe9f8/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:40.452573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.452857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.453131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.481249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] MFA Rules not processed for user `ece5b01465a24e068bb255ce589fe9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:40.483033 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:40.554305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 962/1945] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:40.566807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.568607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:40.630602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ec6ec-5d29-44cd-82bc-79b8aeaac3b6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.634312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.634920 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.635195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.635487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.645715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.647156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.658042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 984/1946] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:40.823471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:40.824847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:40.837575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142fe9-d897-4f79-b02c-580ad9120dbd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:40.841101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:40.841688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:40.842604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:40.842868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:40.872548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:40.906811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:40.908287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e90b0-18c8-4035-af36-a259742b767b service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:40.917879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 963/1947] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:45.873774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:45.875454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:45.944087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8d3a-a90d-471c-b846-0ec16d47c8d8 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:45.948644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:45.949272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:45.949578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:45.949849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] PATH_INFO: `/v3/users/623122bdc22249e1a0c67a2a49a85d16` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:45.950972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=623122bdc22249e1a0c67a2a49a85d16)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:45.953632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:45.999768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623122bdc22249e1a0c67a2a49a85d16'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.000428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623122bdc22249e1a0c67a2a49a85d16'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.007507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623122bdc22249e1a0c67a2a49a85d16'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.008147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623122bdc22249e1a0c67a2a49a85d16'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.018728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623122bdc22249e1a0c67a2a49a85d16'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.041591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 985/1948] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:45 2022] DELETE /identity/v3/users/623122bdc22249e1a0c67a2a49a85d16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:46.047104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.047614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.047804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.069240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:46.070533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.183817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 964/1949] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:46.194192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.195684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.201872 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:46.277804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea598d-349e-47cf-937a-32eb280b3a9d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.282260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.282802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.283073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.283369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.293476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.295014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d17e-1678-45ea-ac82-647b45ca920b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.305608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 986/1950] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:46.350015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.351518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.363304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d148ac-99d8-45d7-9f3a-d5163fb64310 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.367943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.368566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.368836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.369100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] PATH_INFO: `/v3/users/2458092f834c4d0fa005643cb33017d0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.370206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2458092f834c4d0fa005643cb33017d0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.372157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.424012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2458092f834c4d0fa005643cb33017d0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.424850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2458092f834c4d0fa005643cb33017d0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.434202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2458092f834c4d0fa005643cb33017d0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.434905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2458092f834c4d0fa005643cb33017d0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.445140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2458092f834c4d0fa005643cb33017d0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.475109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 965/1951] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:46 2022] DELETE /identity/v3/users/2458092f834c4d0fa005643cb33017d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:46.479402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.479686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.479954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.500332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:46.501534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.576314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 987/1952] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:46.586661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.588202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.600267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.601942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.616215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e91362-1dd3-4fed-9f4e-b0600b413860 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.624486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.625152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.625515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.625748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] PATH_INFO: `/v3/projects/b275286be4634c5f8def564b73b5dead` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.627024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b275286be4634c5f8def564b73b5dead)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.629191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.651318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:46.671408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a284d9-2e29-40aa-904a-aa1fa6c524e5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.689441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b275286be4634c5f8def564b73b5dead', 'request_id': 'req-fe22c21a-de0d-4784-8365-9e328b333fac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.699302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b275286be4634c5f8def564b73b5dead', 'request_id': 'req-fe22c21a-de0d-4784-8365-9e328b333fac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.708133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b275286be4634c5f8def564b73b5dead', 'request_id': 'req-fe22c21a-de0d-4784-8365-9e328b333fac'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.719869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] The token cache is being invalidate because project b275286be4634c5f8def564b73b5dead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:46.720283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.721022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-fe22c21a-de0d-4784-8365-9e328b333fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:46.722608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 988/1953] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:46 2022] DELETE /identity/v3/projects/b275286be4634c5f8def564b73b5dead => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:46.725585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.726298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.726662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.727028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.727317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.727604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.727879 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.729263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.753387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:46.754703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.783079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:46.799959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.801428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d7569-d912-4eca-b121-11b026b2b945 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.812603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 966/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:46.826765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 989/1955] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:46.835382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.835714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.836064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.856366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:46.857565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:46.867084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 967/1956] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:46.871682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.883589 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780850ee-2d20-4ff2-9b8a-a29e828a654e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.889122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.889796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.890278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.890659 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.891365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:46.891644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.893251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.905784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 990/1957] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:46.909939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.920155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb71143-4f5a-4e67-813e-8e72a2d89160 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:46.926159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:46.926832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:46.927169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:46.927469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:46.928103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:46.930022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:46.962899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 968/1958] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:46.964353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:46.976704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cf299-22f1-40d7-a25a-48b56f419b38 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.036694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.037301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.037643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.037840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.038473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.040426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.066263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 991/1959] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:46 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:47.067573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.079251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde127d-2bbc-4e89-8a15-7b713c9cfb73 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.084950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.085758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.086110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.086463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.087119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.088760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.093720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.096048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.109432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 969/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:47.111036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.111940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8a89-69ee-45e9-83ff-1f674f155e24 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.117130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.117768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.118079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.118352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] PATH_INFO: `/v3/projects/b3edcdf06fe64a3f9613e3f686752c45` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.119603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3edcdf06fe64a3f9613e3f686752c45)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.121668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.121857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1d4d-0af4-41f1-a745-3e2678ad24c3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.129198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.129546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.129828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.130094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.131356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.133620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.147442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 970/1961] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:47.154079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.175779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1c0a5-7f0a-4348-bd5c-a47c819325a7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.182045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.182971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.183250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.183572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] PATH_INFO: `/v3/projects/f3cbd8b641f64a5b9f5eabd385c4bf15/users/bfc1a350474e479ca734921deea966db/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.195538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3edcdf06fe64a3f9613e3f686752c45', 'request_id': 'req-3e22399b-047b-419b-8115-fae58fefd7f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.203483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3cbd8b641f64a5b9f5eabd385c4bf15, user_id=bfc1a350474e479ca734921deea966db, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.206752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a6eff-f583-4e1e-acf6-d6d0d233d018 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.220471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3edcdf06fe64a3f9613e3f686752c45', 'request_id': 'req-3e22399b-047b-419b-8115-fae58fefd7f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.227935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 971/1962] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:47 2022] PUT /identity/v3/projects/f3cbd8b641f64a5b9f5eabd385c4bf15/users/bfc1a350474e479ca734921deea966db/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:47.228935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3edcdf06fe64a3f9613e3f686752c45', 'request_id': 'req-3e22399b-047b-419b-8115-fae58fefd7f9'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.240029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.240325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.240707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.250096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] The token cache is being invalidate because project b3edcdf06fe64a3f9613e3f686752c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:47.250389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.251571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.255641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 992/1963] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:47 2022] DELETE /identity/v3/projects/b3edcdf06fe64a3f9613e3f686752c45 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:47.260103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.261839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.300108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] MFA Rules not processed for user `bfc1a350474e479ca734921deea966db`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:47.301345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.324430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:47.350929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:47.388619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 972/1964] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:47.398308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.400584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.409555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22399b-047b-419b-8115-fae58fefd7f9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.488929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0f5ef-6cd6-43dd-9d16-2f376e5176f0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.492957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.493627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.493952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.494225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.496523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.497165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.497445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.497715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] PATH_INFO: `/v3/users/ece5b01465a24e068bb255ce589fe9f8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.498839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece5b01465a24e068bb255ce589fe9f8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.500932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.502772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.504267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.513092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 973/1965] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:47.541942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.543547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.558255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24968fd-8f38-4612-9e2f-5816305b24ec service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.561294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece5b01465a24e068bb255ce589fe9f8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.562111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece5b01465a24e068bb255ce589fe9f8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.563146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.563806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.564081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.564352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] PATH_INFO: `/v3/users/bfc1a350474e479ca734921deea966db` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.565483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc1a350474e479ca734921deea966db)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.567454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.570520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece5b01465a24e068bb255ce589fe9f8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.571367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece5b01465a24e068bb255ce589fe9f8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.583414 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f35283d7-0976-4a67-a000-b84735544201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece5b01465a24e068bb255ce589fe9f8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.607379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 993/1966] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:47 2022] DELETE /identity/v3/users/ece5b01465a24e068bb255ce589fe9f8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:47.620816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc1a350474e479ca734921deea966db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.621590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc1a350474e479ca734921deea966db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.629991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc1a350474e479ca734921deea966db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.630678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc1a350474e479ca734921deea966db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.638831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc1a350474e479ca734921deea966db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.662936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 974/1967] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:47 2022] DELETE /identity/v3/users/bfc1a350474e479ca734921deea966db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:47.668258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.668673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.669060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.694624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:47.695876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.750874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:47.769319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 994/1968] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:47.778748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.781148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.819811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:47.848106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb935-415d-4187-add1-2806fb6f3630 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.851788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.852398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.852671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.852937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.863592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.865247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b810f45-6e77-4859-a22b-9069596db232 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.876278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 975/1969] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:47.904874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:47.907710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:47.921608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b173860-d523-40a2-8ec6-62d66699eba5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:47.927101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:47.927563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:47.927840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:47.928520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] PATH_INFO: `/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:47.929427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22b93fdbcd64f488d95ae77ea2a169f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:47.931494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:47.986582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22b93fdbcd64f488d95ae77ea2a169f', 'request_id': 'req-172590b4-086f-4435-8e94-1e7e74922543'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:47.994547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22b93fdbcd64f488d95ae77ea2a169f', 'request_id': 'req-172590b4-086f-4435-8e94-1e7e74922543'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.001766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22b93fdbcd64f488d95ae77ea2a169f', 'request_id': 'req-172590b4-086f-4435-8e94-1e7e74922543'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.013699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] The token cache is being invalidate because project c22b93fdbcd64f488d95ae77ea2a169f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:48.013997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.014728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-172590b4-086f-4435-8e94-1e7e74922543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.019657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 995/1970] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:47 2022] DELETE /identity/v3/projects/c22b93fdbcd64f488d95ae77ea2a169f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:48.021334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.021643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.021917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.042084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:48.043317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.113043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 976/1971] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:48.120623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.120907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.121176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.141919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:48.143127 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.151307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 996/1972] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:48.156334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.166469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585c7de-a4ee-4a99-9dce-98baa8a1d8c5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.171235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.171867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.172147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.172420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.173064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:48.173366 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.174975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.188043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 977/1973] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:48.191941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.193634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.194292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.206696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca22d-a42c-466a-89f8-478a91cf7f67 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.212919 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.213538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.213815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.214083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.215755 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.216872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.239777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efc918-4932-4387-afbe-9949f3dac219 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.245642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.246484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.246814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.247655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] PATH_INFO: `/v3/projects/f3cbd8b641f64a5b9f5eabd385c4bf15` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.249645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3cbd8b641f64a5b9f5eabd385c4bf15)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.251417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.255488 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 978/1974] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:48.256805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.317177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3cbd8b641f64a5b9f5eabd385c4bf15', 'request_id': 'req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.329379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3cbd8b641f64a5b9f5eabd385c4bf15', 'request_id': 'req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.336715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee8da-21c6-45f1-ba67-b566f84d54e9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.340898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3cbd8b641f64a5b9f5eabd385c4bf15', 'request_id': 'req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.359364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] The token cache is being invalidate because project f3cbd8b641f64a5b9f5eabd385c4bf15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:48.360100 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.360780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d8ba6ab4-0e2a-42b0-b5e0-8a1aebed4d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:48.364778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 997/1975] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:48 2022] DELETE /identity/v3/projects/f3cbd8b641f64a5b9f5eabd385c4bf15 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:48.373669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9691d-7b24-4ee3-b1b7-8f73afb0f672 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.374142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9691d-7b24-4ee3-b1b7-8f73afb0f672 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.374797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9691d-7b24-4ee3-b1b7-8f73afb0f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.400365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c0c9691d-7b24-4ee3-b1b7-8f73afb0f672 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:48.401910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c0c9691d-7b24-4ee3-b1b7-8f73afb0f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.421998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:48.443720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.447476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.447940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.448395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.449242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.453010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.465057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:48.485883 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 979/1976] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:48.487183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 998/1977] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:48.492732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.494954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.496388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.496664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.497128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.509590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62535340-f7c2-4633-9db4-512d5579e0ee admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.515182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.516392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.516754 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.516921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.517563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.519487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.529665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:48.532925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.534221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 980/1978] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:48.537714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.547694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 999/1979] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:48.549738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafac6-fae9-408f-81da-1ddc4f20b82e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.551310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.565748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dded4-dbb1-49b0-b239-75912c06a446 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.566774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.567774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.569413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.569413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.569413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.571419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.572347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.573098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.573227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.573532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.574218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:48.574526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.576266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.588705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 981/1980] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:48.589802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.593728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1000/1981] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 17:56:48.594749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.609059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2676-bf53-4fa9-bb94-077178c85c8c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.614213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17cf30-3e1b-45bf-b016-95cfe8045ec9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.619820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.620205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.620551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.621079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.621796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.623128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.623921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.624082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.624968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.625243 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] PATH_INFO: `/v3/projects/70f0a48642374ef29a69ee2ca18291d7/users/48d45167584b4273ba303ed81f0d7c81/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.652176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f0a48642374ef29a69ee2ca18291d7, user_id=48d45167584b4273ba303ed81f0d7c81, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.668061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74538-c151-409d-9f98-28572109dbd1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.675936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1001/1982] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/projects => generated 399 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:48.681357 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.700756 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 982/1983] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:48 2022] PUT /identity/v3/projects/70f0a48642374ef29a69ee2ca18291d7/users/48d45167584b4273ba303ed81f0d7c81/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:48.706133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.706451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.706720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.730495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:48.734736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.776137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e9e6-9774-4338-b562-9b56bdb500db admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.817321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 983/1984] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:48.825566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.826973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:48.840562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.841183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.841722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.842047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.843423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.846307 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.875176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1002/1985] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:48 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:48.876310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.886582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53b3b-e203-4f87-9e0f-40d28c347e25 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.892895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.893590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.893902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.894377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.894783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbfa27-4dc0-4cbd-826b-29cb72970772 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.894907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.896483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.898390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.898990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.899260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.899549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.911110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1003/1986] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:48.912603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.913734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.915179 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.922874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dce496-05a1-44f0-8963-49adba5233fa admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.925412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 984/1987] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:48.927761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.928364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.928691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.928964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.929608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.931202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d74627-5aa6-43d8-9c4f-c2fc49b97cf3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:48.942951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1004/1988] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:48.947252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:48.959349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836ecb-703e-4444-9f8e-e6937d089290 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:48.964259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:48.964915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:48.965187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:48.965489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] PATH_INFO: `/v3/projects/41ee1a0d48fb4cf5bb81f8a3c558df07/users/89875b18810c487dba183844eeffff9d/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:48.982142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee1a0d48fb4cf5bb81f8a3c558df07, user_id=89875b18810c487dba183844eeffff9d, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:48.985479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:49.003931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 985/1989] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:48 2022] PUT /identity/v3/projects/41ee1a0d48fb4cf5bb81f8a3c558df07/users/89875b18810c487dba183844eeffff9d/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:49.015400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3228-9ca2-4f46-a30c-38e0bff3d3d2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:49.015718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3228-9ca2-4f46-a30c-38e0bff3d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:49.016075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3228-9ca2-4f46-a30c-38e0bff3d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:49.046775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-254d3228-9ca2-4f46-a30c-38e0bff3d3d2 None None] MFA Rules not processed for user `89875b18810c487dba183844eeffff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:49.048041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-254d3228-9ca2-4f46-a30c-38e0bff3d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:49.067713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:49.129363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1005/1990] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:49.141864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:49.143613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:49.163088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:49.211947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065634c-c1df-465f-8057-8a736d2df417 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:49.215643 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:49.216244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:49.216534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:49.216822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:49.225625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:49.227807 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:49.239295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 986/1991] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:49.636406 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3259b9-c074-4831-bced-92032891b669 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:49.636619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3259b9-c074-4831-bced-92032891b669 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:49.636845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3259b9-c074-4831-bced-92032891b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:49.674726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-de3259b9-c074-4831-bced-92032891b669 None None] MFA Rules not processed for user `48d45167584b4273ba303ed81f0d7c81`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:49.694733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-de3259b9-c074-4831-bced-92032891b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:49.780028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:49.781766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:49.897387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1006/1992] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:49.902184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3259b9-c074-4831-bced-92032891b669 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:49.924617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082983c6-5a02-4012-8fca-570bfd3772d0 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:49.932815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:49.933473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:49.933851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:49.934225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] PATH_INFO: `/v3/users/749e671bf94d480c899773a927ae4a55` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:49.935979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749e671bf94d480c899773a927ae4a55)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:49.939793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:49.982037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3259b9-c074-4831-bced-92032891b669 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:49.988122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:49.988735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:49.988988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:49.989264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:49.989886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:49.992058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.003006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749e671bf94d480c899773a927ae4a55'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.003806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749e671bf94d480c899773a927ae4a55'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.014265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749e671bf94d480c899773a927ae4a55'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.015381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749e671bf94d480c899773a927ae4a55'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.022211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1007/1993] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:49 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:50.026803 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.027169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-342c9b77-9f9d-43c4-a2e0-78bf2efafed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749e671bf94d480c899773a927ae4a55'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.028507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:50.050425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 987/1994] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:49 2022] DELETE /identity/v3/users/749e671bf94d480c899773a927ae4a55 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:50.054706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.055009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.055241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.070512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:50.075781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:50.077162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:50.113149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88113b-d564-425a-b2a5-844f0b9bcb42 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.119641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:50.162705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 988/1995] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:50.173238 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.175330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:50.188561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.189186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.189467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.189732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.190374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.193917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.232275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1008/1996] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:50 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:56:50.234171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.249983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771f70-d667-436a-9be3-ca15144219f6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.257385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52ebb-6669-4cff-a606-a4c5c9031940 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.260990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.261616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.261804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.261945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.262150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.262879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.262879 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.263080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.263164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.265259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.273815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.275534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.275848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1009/1997] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:50.280104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.289287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 989/1998] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:56:50.294505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc906b-3ac5-475e-a4c5-7b1e46d617ba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.299641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.300385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.300971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.300971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] PATH_INFO: `/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d/users/aca3307dc4374027ac67f6654204d09e/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.319727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b03bc9aa1b4a3d81bea4461eb9613d, user_id=aca3307dc4374027ac67f6654204d09e, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.324023 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.342487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1010/1999] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:50 2022] PUT /identity/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d/users/aca3307dc4374027ac67f6654204d09e/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:56:50.347041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.364447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fc96a-464f-4512-b169-d4879c19aa27 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.459108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.459818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.460092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.460359 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.476194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.480790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.511350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 990/2000] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:56:50.520627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.536270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08698-b33f-4e6e-b2c2-4cf3dc18f2fb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.541200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.541875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.542289 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.542895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] PATH_INFO: `/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d/users/aca3307dc4374027ac67f6654204d09e/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.544951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b03bc9aa1b4a3d81bea4461eb9613d, user_id=aca3307dc4374027ac67f6654204d09e, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.553529 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7222-1233-420d-995f-734e0ed35684 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.566266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1011/2001] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:50 2022] PUT /identity/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d/users/aca3307dc4374027ac67f6654204d09e/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:50.640770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:50.643249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:50.658703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b8df5-5564-4828-bde4-4eef3a589977 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:50.728814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:50.729461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:50.729758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:50.730017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] PATH_INFO: `/v3/projects/48c57a1bd36d40ec925d9e854823784e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:50.731163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c57a1bd36d40ec925d9e854823784e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:50.733139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:50.754210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:50.796371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c57a1bd36d40ec925d9e854823784e', 'request_id': 'req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.804002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c57a1bd36d40ec925d9e854823784e', 'request_id': 'req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.814793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c57a1bd36d40ec925d9e854823784e', 'request_id': 'req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.827627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] The token cache is being invalidate because project 48c57a1bd36d40ec925d9e854823784e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:50.827913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.828848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-8d6bba95-ce6e-4679-9ea3-d4ef1f740408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:50.830949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 991/2002] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:50 2022] DELETE /identity/v3/projects/48c57a1bd36d40ec925d9e854823784e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:51.522251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:51.522708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:51.522798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:51.554643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] MFA Rules not processed for user `aca3307dc4374027ac67f6654204d09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:51.555893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:51.688993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1012/2003] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:51.692283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:51.692778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:51.692855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:51.719960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] MFA Rules not processed for user `48d45167584b4273ba303ed81f0d7c81`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:51.721260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:51.806996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 992/2004] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:51.818609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:51.820156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:51.834467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:51.908259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e86e7-c26d-4637-9660-6c6201d8e519 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:51.914513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:51.915199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:51.915512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:51.915781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:51.917574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:51.929560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:51.931248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86d1ea-10d0-4ff1-837c-10b390c8ca76 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:51.940816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1013/2005] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:54.485364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:54.488337 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:54.560312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb244e0-6c19-452d-8050-4cfd166c5209 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:54.565062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:54.565698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:54.565972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:54.566239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] PATH_INFO: `/v3/users/89875b18810c487dba183844eeffff9d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:54.567412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89875b18810c487dba183844eeffff9d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:54.569345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:54.620704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89875b18810c487dba183844eeffff9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:54.621411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89875b18810c487dba183844eeffff9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:54.623888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:54.630321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89875b18810c487dba183844eeffff9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:54.631298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89875b18810c487dba183844eeffff9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:54.639665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89875b18810c487dba183844eeffff9d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:54.660316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 993/2006] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:56:54 2022] DELETE /identity/v3/users/89875b18810c487dba183844eeffff9d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:54.664581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:54.665028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:54.665137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:54.684696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:54.685886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:54.747578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1014/2007] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:54.765002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:54.769330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:54.861795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef1e-b1b5-4f0d-aa12-bc8484ee68a3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:54.865590 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:54.866224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:54.866501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:54.866765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:54.877318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:54.878752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc409046-0f7b-4a10-9b79-31fff6a7fe98 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:54.890212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 994/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:56:55.330484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.332228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:55.344367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbabbc6-d937-442d-9676-422944e32a3e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.351313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.351313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.351313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.351313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] PATH_INFO: `/v3/projects/41ee1a0d48fb4cf5bb81f8a3c558df07` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.352301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ee1a0d48fb4cf5bb81f8a3c558df07)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.354294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.410842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ee1a0d48fb4cf5bb81f8a3c558df07', 'request_id': 'req-4278512f-2116-4db8-aed4-213eddf15933'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:55.420112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ee1a0d48fb4cf5bb81f8a3c558df07', 'request_id': 'req-4278512f-2116-4db8-aed4-213eddf15933'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:55.430450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ee1a0d48fb4cf5bb81f8a3c558df07', 'request_id': 'req-4278512f-2116-4db8-aed4-213eddf15933'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:55.443662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] The token cache is being invalidate because project 41ee1a0d48fb4cf5bb81f8a3c558df07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:56:55.443987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:55.444827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4278512f-2116-4db8-aed4-213eddf15933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:56:55.446899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1015/2009] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:56:55 2022] DELETE /identity/v3/projects/41ee1a0d48fb4cf5bb81f8a3c558df07 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:55.453630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.453911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.454394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.476985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:55.478949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:55.555672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 995/2010] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:56:55.564440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.568151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.568443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.589089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:55.590284 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:55.598560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1016/2011] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:55.603014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.613363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e3de2-730d-4275-b28f-308a8f7658b0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.617955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.618588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.618864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.619130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.619807 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:56:55.620107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.622329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.634634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 996/2012] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:56:55.639108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.650542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac311eb-0e4f-4813-8992-3e13b7171b63 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.655420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.656327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.656512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.656842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.657548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.659572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.665240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:55.696311 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1017/2013] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:56:55 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:55.697925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.709087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420965-acb2-4399-9c7b-5d05152c91f3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.770389 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:56:55.778479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.779235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.779569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.780271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.781205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.783423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.808729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 997/2014] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:56:55 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:56:55.809916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.820938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e53e4f-3aac-4464-9dd9-986d7561c2fe admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.825481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.826073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.826345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.826776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.827601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.829175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.841696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1018/2015] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:55.847908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.858885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d99c6-d747-4b17-8c14-e396d3b173de admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.864290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.864903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.865188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.865637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.866303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.868055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89b4d-8bc0-420c-b9d8-18f1ccd66a74 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.880048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 998/2016] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:56:55.884412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:55.898069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0cf9-6510-4720-b47b-16ef52195df8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:55.903054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:55.903843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.904122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.904395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] PATH_INFO: `/v3/projects/0562fec8a7404f6aa4cf476a162cfba7/users/1f973db8e45745a6bb69a540d4f422d4/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.919911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0562fec8a7404f6aa4cf476a162cfba7, user_id=1f973db8e45745a6bb69a540d4f422d4, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:55.923378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:55.937345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1019/2017] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:56:55 2022] PUT /identity/v3/projects/0562fec8a7404f6aa4cf476a162cfba7/users/1f973db8e45745a6bb69a540d4f422d4/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:56:55.942208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65197a-2d45-47af-adb9-3d47503a9e5d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:55.942495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65197a-2d45-47af-adb9-3d47503a9e5d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:55.942767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65197a-2d45-47af-adb9-3d47503a9e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:55.968500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4d65197a-2d45-47af-adb9-3d47503a9e5d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:56:55.969902 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4d65197a-2d45-47af-adb9-3d47503a9e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:56.032775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 999/2018] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:56:56.042485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:56:56.044194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:56:56.109153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0ce2-4f8c-439d-b725-978f2be10c9d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:56:56.113057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:56:56.113664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:56:56.113941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:56:56.114211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:56:56.123434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:56:56.125493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:56:56.138288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1020/2019] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:00.805797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:00.817669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:00.818137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:00.881487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] MFA Rules not processed for user `1f973db8e45745a6bb69a540d4f422d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:00.882804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:01.039395 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1000/2020] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:01.042374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.056583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b841-104f-4062-938c-59a2e8a5a4bc service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.069864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.072053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.073035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.073482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.074300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.094888 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.191418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1021/2021] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:57:01 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:01.192408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.210576 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd031f5-996b-41d9-bb3a-358d3e7c5010 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.343500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.344125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.344458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.344728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.345371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.347352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.358794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:01.375983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1001/2022] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:57:01 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:01.379139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.398050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce9753-8dca-4b60-8b5e-6547ef1d381a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.402921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.403562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.403832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.404104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.404794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.406689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.419328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1022/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:01.423535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.434386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fe5b7-cc94-4297-9665-9e84791bdf71 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.442140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.442824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.443111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.443534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] PATH_INFO: `/v3/projects/b8723dc11420421087e696576a777566/users/a144ced1439843beb57cb6134348e70d/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.462949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8723dc11420421087e696576a777566, user_id=a144ced1439843beb57cb6134348e70d, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.467021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.503825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1002/2024] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:01 2022] PUT /identity/v3/projects/b8723dc11420421087e696576a777566/users/a144ced1439843beb57cb6134348e70d/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:01.511147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.525337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ee2d-865d-491b-922d-f1ad95f7f327 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.589665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.590280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.590560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.590831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.591516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.593686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.604865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1023/2025] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:01.609017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:01.619896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c469a43-06ca-4bc1-9791-6ee3f79791bf admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:01.629963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:01.630677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:01.630961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:01.631230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] PATH_INFO: `/v3/projects/b8723dc11420421087e696576a777566/users/a144ced1439843beb57cb6134348e70d/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:01.633287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8723dc11420421087e696576a777566, user_id=a144ced1439843beb57cb6134348e70d, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:01.635989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55327-3c3e-47a3-b85c-d8c3126e0cb1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:01.648346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1003/2026] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:01 2022] PUT /identity/v3/projects/b8723dc11420421087e696576a777566/users/a144ced1439843beb57cb6134348e70d/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:06.081273 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:06.084207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:06.119943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:06.191412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf9d39-6a82-40ff-9770-1785733911f8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:06.249343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:06.250237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:06.250968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:06.251550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:06.253832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:06.357376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:06.360350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e9ac-60a4-449d-b24a-312ef80fe835 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:06.386175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1024/2027] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:06.845368 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:06.846208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:06.846612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:06.882825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:06.884091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:07.036563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1004/2028] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:07.059611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c5d3-1261-4894-a36f-24b315ec7953 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:07.059904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c5d3-1261-4894-a36f-24b315ec7953 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:07.060185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c5d3-1261-4894-a36f-24b315ec7953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:07.082220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:07.084023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:07.123877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-b453c5d3-1261-4894-a36f-24b315ec7953 None None] MFA Rules not processed for user `a144ced1439843beb57cb6134348e70d`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:07.125120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b453c5d3-1261-4894-a36f-24b315ec7953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:07.215884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778034b-77cd-4b67-8997-b063e001f83d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:07.224256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:07.224891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:07.225310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:07.225568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:07.240459 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:07.247890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:07.266358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1005/2029] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:57:07.305434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1025/2030] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:07.319325 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:07.321075 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:07.390893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:07.409694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c1c75-d271-40b1-858a-2268d60c463d service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:07.418071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:07.418819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:07.419242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:07.419715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:07.522872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:07.524527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:07.538704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1006/2031] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:07.824901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4913-473d-4c88-a1f1-f19788b47da1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:07.825206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4913-473d-4c88-a1f1-f19788b47da1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:07.825481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4913-473d-4c88-a1f1-f19788b47da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:07.879330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-fbef4913-473d-4c88-a1f1-f19788b47da1 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:07.880840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-fbef4913-473d-4c88-a1f1-f19788b47da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:07.887710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:07.955069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1026/2032] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:08.001464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:08.003065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:08.085344 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0742348-3816-41d2-8fc1-4005ebff4b4f service glance] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:08.091407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:08.092400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:08.092679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:08.093059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:08.102736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:08.104649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:08.114652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1007/2033] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:57:12.304039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6d65-5e2f-4b77-b7fc-8992460a8d5d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:12.304668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6d65-5e2f-4b77-b7fc-8992460a8d5d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:12.304668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6d65-5e2f-4b77-b7fc-8992460a8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:12.332402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-504d6d65-5e2f-4b77-b7fc-8992460a8d5d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:12.334049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-504d6d65-5e2f-4b77-b7fc-8992460a8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:12.349752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1027/2034] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:12.367629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:12.369126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:12.393641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3dba-1d29-4189-b8c9-67cf9e112617 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:12.400525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:12.401256 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:12.401533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:12.401828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:12.414004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:12.416295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf33fd-2738-4318-b5ce-6f841c526dc8 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:12.430699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1008/2035] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:15.047356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:15.047821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:15.047916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:15.069238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] MFA Rules not processed for user `6a5d2cb64aa841d0b3303581aaf3d36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:15.070698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:15.140004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1028/2036] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:15.830714 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219679-e84d-443d-8128-6dc165eb148c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:15.831317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219679-e84d-443d-8128-6dc165eb148c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:15.831317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219679-e84d-443d-8128-6dc165eb148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:15.861948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9f219679-e84d-443d-8128-6dc165eb148c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:15.863593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9f219679-e84d-443d-8128-6dc165eb148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:15.873940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1009/2037] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:16.275987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:16.295107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c999a-0da1-4f34-8eeb-1086b27c59a6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:16.328254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:16.328892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:16.329168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:16.329439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:16.340816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:16.343990 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:16.378272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1029/2038] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:19.023559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e0b5-78e4-4cd5-ba17-5fd7974634a5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:19.025046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e0b5-78e4-4cd5-ba17-5fd7974634a5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:19.025662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8e0b5-78e4-4cd5-ba17-5fd7974634a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:19.101306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-69f8e0b5-78e4-4cd5-ba17-5fd7974634a5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:19.103019 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69f8e0b5-78e4-4cd5-ba17-5fd7974634a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:19.119629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1010/2039] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:19.134335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:19.155006 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3979d8-ffac-4e0e-b1c4-2d8bbe2342b7 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:19.163115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:19.163868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:19.164205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:19.164534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:19.184845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:19.192172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9631ad-b804-4d90-81f0-a4911217d9d5 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:19.208421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1030/2040] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:20.293656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:20.294158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:20.294247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:20.313385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] MFA Rules not processed for user `1f973db8e45745a6bb69a540d4f422d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:20.314789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:20.321551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1011/2041] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:24.302856 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa1be-ec0f-4705-b65b-00cca1c9a843 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:24.303674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa1be-ec0f-4705-b65b-00cca1c9a843 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:24.304094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa1be-ec0f-4705-b65b-00cca1c9a843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:24.329653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-749fa1be-ec0f-4705-b65b-00cca1c9a843 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:24.331773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-749fa1be-ec0f-4705-b65b-00cca1c9a843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:24.340603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1031/2042] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:24.355791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:24.368972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7d3f2-3e93-4641-910b-25bd8af7b9c0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:24.375125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:24.375829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:24.376391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:24.376642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:24.385539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:24.387151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84067cb9-c454-4f77-a1d8-645d16fc1bff service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:24.398805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1012/2043] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:25.262998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:25.263593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:25.264065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:25.293272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] MFA Rules not processed for user `5cd61d7e706d46c6992c7abbbfc4b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:25.296036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:25.369210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1032/2044] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:26.038387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:26.038953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:26.039166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:26.076715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:26.078374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:26.087198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1013/2045] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:57:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:26.106169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:26.120622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae382488-9ee9-449a-895f-c5189a2cb5ed None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:26.127550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:26.128447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:26.128914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:26.129386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:26.138838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:26.140773 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:26.150103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1033/2046] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:57:34.876962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:34.878540 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:34.897039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79619779-5876-49b4-ad3f-3bea3d239cdb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:34.911535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:34.912674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:34.912979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:34.913244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] PATH_INFO: `/v3/users/48d45167584b4273ba303ed81f0d7c81` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:34.914476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d45167584b4273ba303ed81f0d7c81)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:34.917528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:34.966940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:34.992348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d45167584b4273ba303ed81f0d7c81'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:34.995264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d45167584b4273ba303ed81f0d7c81'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.011813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d45167584b4273ba303ed81f0d7c81'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.013726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d45167584b4273ba303ed81f0d7c81'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.025597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d45167584b4273ba303ed81f0d7c81'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.074298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1014/2047] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:57:34 2022] DELETE /identity/v3/users/48d45167584b4273ba303ed81f0d7c81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:35.274122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:35.286186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd880-2ffe-49b0-b81d-c28c3e7c8ac2 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:35.297890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:35.354062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:35.355191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:35.355729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:35.356099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] PATH_INFO: `/v3/projects/70f0a48642374ef29a69ee2ca18291d7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:35.357396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f0a48642374ef29a69ee2ca18291d7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:35.359801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:35.411754 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f0a48642374ef29a69ee2ca18291d7', 'request_id': 'req-f17ae2f9-4e4c-4055-8e03-b73701ec4818'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.421144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f0a48642374ef29a69ee2ca18291d7', 'request_id': 'req-f17ae2f9-4e4c-4055-8e03-b73701ec4818'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.431601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f0a48642374ef29a69ee2ca18291d7', 'request_id': 'req-f17ae2f9-4e4c-4055-8e03-b73701ec4818'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.442963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] The token cache is being invalidate because project 70f0a48642374ef29a69ee2ca18291d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:57:35.443246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.443952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.445457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1034/2048] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:57:35 2022] DELETE /identity/v3/projects/70f0a48642374ef29a69ee2ca18291d7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:35.449745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:35.451251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:35.466289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b7a29-0cae-46ad-8f24-e2b420ae1add admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:35.522494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:35.523130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:35.523434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:35.523707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] PATH_INFO: `/v3/users/aca3307dc4374027ac67f6654204d09e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:35.524817 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca3307dc4374027ac67f6654204d09e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:35.526747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:35.573873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca3307dc4374027ac67f6654204d09e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.574511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca3307dc4374027ac67f6654204d09e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.582301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca3307dc4374027ac67f6654204d09e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.582937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca3307dc4374027ac67f6654204d09e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.589811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0c68d7bd-77da-4fce-a642-48868b09a4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca3307dc4374027ac67f6654204d09e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:35.608086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1015/2049] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:57:35 2022] DELETE /identity/v3/users/aca3307dc4374027ac67f6654204d09e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:57:35.871075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:35.872958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:35.908771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ae2f9-4e4c-4055-8e03-b73701ec4818 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:35.974505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:35.975404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:35.975678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:35.975972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] PATH_INFO: `/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:35.977115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b03bc9aa1b4a3d81bea4461eb9613d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:35.979031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.033134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:36.038852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b03bc9aa1b4a3d81bea4461eb9613d', 'request_id': 'req-ee1b3aff-61bf-4718-8340-d107ba91b14d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:36.049326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b03bc9aa1b4a3d81bea4461eb9613d', 'request_id': 'req-ee1b3aff-61bf-4718-8340-d107ba91b14d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:36.056724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b03bc9aa1b4a3d81bea4461eb9613d', 'request_id': 'req-ee1b3aff-61bf-4718-8340-d107ba91b14d'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:36.068189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] The token cache is being invalidate because project f6b03bc9aa1b4a3d81bea4461eb9613d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:57:36.068600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:36.069255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-ee1b3aff-61bf-4718-8340-d107ba91b14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:36.070751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1035/2050] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:57:35 2022] DELETE /identity/v3/projects/f6b03bc9aa1b4a3d81bea4461eb9613d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:36.075869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.076387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.077434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.098047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:36.099232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:36.121051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:36.179435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1016/2051] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:36.183032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.183568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.183845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.207210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:36.208483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:36.219338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1036/2052] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:36.223502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.233979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8747a5-0d19-4ab9-8a57-fb534b3ca6d1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.238710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.239348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.239627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.239895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.240536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:57:36.240833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.242550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.259665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1017/2053] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:57:36.262676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.273163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7b05-1197-42b9-9200-6d28f618a4eb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.278401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.279767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.279989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.280726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.281119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.283058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.337501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1037/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:36.342234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.354671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce2df-fe83-4581-bdae-e33a81c964ba admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.424175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.424798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.425255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.425577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.426229 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.428336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.458521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1018/2055] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:57:36.462835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.474493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcaa8f-b2bc-4bae-a146-5a0473f5ad64 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.479475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.480159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.480497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.480867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.482235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.483936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.496428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1038/2056] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:36.501887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.514066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55ef2a-87d9-4e3d-b2d8-0ed19bb6a4cd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.519984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.520797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.521168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.521557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.522271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.524216 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add17c40-8568-4f61-9dcb-dc8a3ffe4658 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.538856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1019/2057] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:36.543570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.557472 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310127fd-a3ba-4d9d-ad3e-d81086a5b2ba admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.564066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.564790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.565079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.565350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] PATH_INFO: `/v3/projects/b5578988fd224bcf82cbb572756b7443/users/b8b69ed27a174a64b854bc121b5fb0c3/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.584764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5578988fd224bcf82cbb572756b7443, user_id=b8b69ed27a174a64b854bc121b5fb0c3, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.587937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.609818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1039/2058] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:36 2022] PUT /identity/v3/projects/b5578988fd224bcf82cbb572756b7443/users/b8b69ed27a174a64b854bc121b5fb0c3/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:36.619054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.619453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.619647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.649903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] MFA Rules not processed for user `b8b69ed27a174a64b854bc121b5fb0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:36.651133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:36.736108 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1020/2059] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:36.740831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.819177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a28f9-90d3-49ff-b69a-18ba64ff471e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.823890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.824483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.824786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.825789 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.826726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.828641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:36.854708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1040/2060] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:57:36.859462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:36.869979 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6c71c-d8a6-4bba-926d-fb43ed6cb2f6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:36.890200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:36.940717 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:36.941585 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:36.942052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:36.942509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:36.946970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:36.949100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.000607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1021/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:57:36 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:37.002839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.027240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873463a-82dc-4f05-9075-301d632186a7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.034812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.035554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.035901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.036237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.036979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.038658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.056453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1041/2062] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:37.057741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.071446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ef920-bc61-4029-88cf-51b3b1371e05 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.077952 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.078716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.078998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.079266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.079951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.081984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a36162-9ae1-414d-b6b0-5a2046c8b0dc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.106822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1022/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:37.107621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.119666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0213b-f550-4a52-bad3-0c99d6aaeedd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.125256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.125917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.126197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.126471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] PATH_INFO: `/v3/projects/057e428d6dfa4146b08383b1ec6fa814/users/d1a0a07276a4422ebe3963ea1e56f255/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.155903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=057e428d6dfa4146b08383b1ec6fa814, user_id=d1a0a07276a4422ebe3963ea1e56f255, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.160358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.179167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1042/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:37 2022] PUT /identity/v3/projects/057e428d6dfa4146b08383b1ec6fa814/users/d1a0a07276a4422ebe3963ea1e56f255/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:57:37.190328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.190617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.190891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.228451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] MFA Rules not processed for user `d1a0a07276a4422ebe3963ea1e56f255`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:37.229669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:37.308472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1023/2065] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:37.315393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.336600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:37.381845 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da97aa-f00f-41b0-897c-43a11b16e54c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.386551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.387157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.387547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.388298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.389129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.391039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.418183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1043/2066] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:37.422675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.433466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc7a8-a3d9-4222-8f3c-b3c0ac39506d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.494131 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.494749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.495027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.495353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.495996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.498695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.519490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1024/2067] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:57:37 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:37.523259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.534009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94083-5aa0-4215-9300-6075db6d23f8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.538603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.539196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.539507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.539780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.540442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.542061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.553312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1044/2068] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:37.557175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.567194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a8a30-a5f8-4ad2-b258-f0582bcfdeb1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.571728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.572364 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.572633 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.572899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] PATH_INFO: `/v3/projects/89e226a567c1442faf28f3b9861f7c15/users/ec24a3b97eb04906bf44b773e816af1b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.587419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e226a567c1442faf28f3b9861f7c15, user_id=ec24a3b97eb04906bf44b773e816af1b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.590054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.593728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:37.604659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1025/2069] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:37 2022] PUT /identity/v3/projects/89e226a567c1442faf28f3b9861f7c15/users/ec24a3b97eb04906bf44b773e816af1b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:37.609294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.619075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8c72-c197-4494-b84e-85103f84566e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.678924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.679653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.679993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.680447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.681171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.682812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7903a9-d5a3-4b8b-ac4a-b14d7ccaa1eb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.702476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1045/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:37.704027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.714937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c337-7346-40a7-abf8-2f14b2102abe admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.720535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.721221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.721491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.721751 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] PATH_INFO: `/v3/projects/89e226a567c1442faf28f3b9861f7c15/users/ec24a3b97eb04906bf44b773e816af1b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.723864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e226a567c1442faf28f3b9861f7c15, user_id=ec24a3b97eb04906bf44b773e816af1b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.726617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:37.737279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1026/2071] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:37 2022] PUT /identity/v3/projects/89e226a567c1442faf28f3b9861f7c15/users/ec24a3b97eb04906bf44b773e816af1b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:37.748192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953e46-8ae8-4f65-bb5d-b4426dbf4115 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.748565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953e46-8ae8-4f65-bb5d-b4426dbf4115 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.748846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953e46-8ae8-4f65-bb5d-b4426dbf4115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.781562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0f953e46-8ae8-4f65-bb5d-b4426dbf4115 None None] MFA Rules not processed for user `ec24a3b97eb04906bf44b773e816af1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:37.783267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0f953e46-8ae8-4f65-bb5d-b4426dbf4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:37.865363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1046/2072] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:37.878666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:37.880490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:37.937832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137359-4d88-4ce4-b7dc-c94288b82d74 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:37.941487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:37.942086 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:37.942361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:37.942626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:37.998457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:37.999920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:38.008553 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1027/2073] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:38.989853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:38.990893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:38.991340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:39.019790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:39.021176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:39.034645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:39.101081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1047/2074] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:39.120479 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:39.123127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:39.210330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a793-7005-4494-899a-fc5c1cb1bc27 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:39.216026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:39.216630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:39.216909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:39.217182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:39.226138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:39.227783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:39.238116 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1028/2075] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:39.585981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:39.597993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f099c6-60ae-43a3-add4-0c1992b39339 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:39.601794 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:39.602532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:39.602898 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:39.603260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:39.679874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:39.681602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98aa4-d3a1-4c52-8143-0c93f48b20a5 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:39.707540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1048/2076] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:40.341387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:40.352036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143a5ec-ffa5-4a6c-b506-3059337b3107 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:40.356676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:40.357373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:40.357652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:40.357916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:40.369378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:40.372301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:40.410010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1029/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:42.544706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:42.545213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:42.545327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:42.569960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:42.572034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:42.659750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1049/2078] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:42.680298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:42.682391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:42.695977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:42.805509 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9bb5f-4855-45c7-94d2-4db3e92ac66f service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:42.811893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:42.812586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:42.813078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:42.813595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:42.824417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:42.826653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4f28-2ad0-4028-97a1-9e07b4cfd9d1 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:42.837496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1030/2079] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:57:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:57:44.772275 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:44.784572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d23a-8cfd-47bd-bc6c-fd47b8c229e1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:44.791103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:44.791788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:44.792114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:44.792329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] PATH_INFO: `/v3/users/b8b69ed27a174a64b854bc121b5fb0c3` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:44.793617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b69ed27a174a64b854bc121b5fb0c3)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:44.795567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:44.877671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b69ed27a174a64b854bc121b5fb0c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:44.879614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b69ed27a174a64b854bc121b5fb0c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:44.893223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:44.899895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b69ed27a174a64b854bc121b5fb0c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:44.902114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b69ed27a174a64b854bc121b5fb0c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:44.919012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b69ed27a174a64b854bc121b5fb0c3'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:44.957718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1050/2080] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:57:44 2022] DELETE /identity/v3/users/b8b69ed27a174a64b854bc121b5fb0c3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:44.958431 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:44.958888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:44.958983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:44.997772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:44.998977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:45.186866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1031/2081] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:45.206936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:45.209151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:45.308738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c5c32-05fa-4de4-a62a-61e95428ab35 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:45.314155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:45.314900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:45.315243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:45.315625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:45.330021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:45.332237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:45.348693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1051/2082] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:45.786272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:45.803223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:45.825234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2f52-d235-41df-a45a-5a77c9264347 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:45.830207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:45.831217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:45.831612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:45.831972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] PATH_INFO: `/v3/projects/b5578988fd224bcf82cbb572756b7443` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:45.835333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5578988fd224bcf82cbb572756b7443)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:45.836649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:45.895460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5578988fd224bcf82cbb572756b7443', 'request_id': 'req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:45.902261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5578988fd224bcf82cbb572756b7443', 'request_id': 'req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:45.911101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5578988fd224bcf82cbb572756b7443', 'request_id': 'req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:45.927527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] The token cache is being invalidate because project b5578988fd224bcf82cbb572756b7443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:57:45.927819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:45.928486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:45.930050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1032/2083] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:57:45 2022] DELETE /identity/v3/projects/b5578988fd224bcf82cbb572756b7443 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:45.934643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:45.946410 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81a890-ab6f-43f9-8d92-e493afb06d94 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:46.009199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:46.010112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:46.010686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:46.010969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] PATH_INFO: `/v3/users/d1a0a07276a4422ebe3963ea1e56f255` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:46.012647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a0a07276a4422ebe3963ea1e56f255)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:46.014778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:46.067298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a0a07276a4422ebe3963ea1e56f255'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.068212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a0a07276a4422ebe3963ea1e56f255'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.079557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a0a07276a4422ebe3963ea1e56f255'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.080655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a0a07276a4422ebe3963ea1e56f255'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.092464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a0a07276a4422ebe3963ea1e56f255'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.102046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:46.123342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1052/2084] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:57:45 2022] DELETE /identity/v3/users/d1a0a07276a4422ebe3963ea1e56f255 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:46.572632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:46.584373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:46.607371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72f91-68d3-4c80-b1d9-71a5e45ad7f2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:46.641134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:46.723628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:46.724503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:46.724781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:46.725044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] PATH_INFO: `/v3/projects/057e428d6dfa4146b08383b1ec6fa814` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:46.734884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057e428d6dfa4146b08383b1ec6fa814)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:46.737100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:46.795213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057e428d6dfa4146b08383b1ec6fa814', 'request_id': 'req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.803960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057e428d6dfa4146b08383b1ec6fa814', 'request_id': 'req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.820562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057e428d6dfa4146b08383b1ec6fa814', 'request_id': 'req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.838972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] The token cache is being invalidate because project 057e428d6dfa4146b08383b1ec6fa814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:57:46.839183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.839869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:46.841848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1033/2085] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:57:46 2022] DELETE /identity/v3/projects/057e428d6dfa4146b08383b1ec6fa814 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:46.845668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:46.847889 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:46.863726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c2f6a-176a-43be-b180-bda593d29c73 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:46.969356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:46.970673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:46.971020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:46.971320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] PATH_INFO: `/v3/users/ec24a3b97eb04906bf44b773e816af1b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:46.973059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec24a3b97eb04906bf44b773e816af1b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:46.976165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:47.069098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec24a3b97eb04906bf44b773e816af1b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.071228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec24a3b97eb04906bf44b773e816af1b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.102797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec24a3b97eb04906bf44b773e816af1b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.103781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec24a3b97eb04906bf44b773e816af1b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.116204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e73a178a-2b22-4a85-b229-2fedea00ecbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec24a3b97eb04906bf44b773e816af1b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.148096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1053/2086] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:57:46 2022] DELETE /identity/v3/users/ec24a3b97eb04906bf44b773e816af1b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:47.505804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:47.507411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:47.538841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e56a7-0f0b-4b19-a5e6-c61e50b19f36 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:47.671808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:47.672527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:47.673374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:47.673374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] PATH_INFO: `/v3/projects/89e226a567c1442faf28f3b9861f7c15` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:47.674357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e226a567c1442faf28f3b9861f7c15)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:47.676647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:47.747428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e226a567c1442faf28f3b9861f7c15', 'request_id': 'req-65e47002-2620-4aa5-8bc4-a615a9b55eeb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.753853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e226a567c1442faf28f3b9861f7c15', 'request_id': 'req-65e47002-2620-4aa5-8bc4-a615a9b55eeb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.756617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:47.767469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e226a567c1442faf28f3b9861f7c15', 'request_id': 'req-65e47002-2620-4aa5-8bc4-a615a9b55eeb'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.792380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] The token cache is being invalidate because project 89e226a567c1442faf28f3b9861f7c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:57:47.792766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.793617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-65e47002-2620-4aa5-8bc4-a615a9b55eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:57:47.799430 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1034/2087] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:57:47 2022] DELETE /identity/v3/projects/89e226a567c1442faf28f3b9861f7c15 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:57:47.801179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:47.801552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:47.801893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:47.827675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:47.828999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:47.904238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1054/2088] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:47.905907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:47.906185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:47.906531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:47.934848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:47.936120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:47.957904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1035/2089] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:57:47.959121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:47.972485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0a43b-c8cf-4867-a363-fcb3e540952e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:47.983631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:47.984399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:47.984800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:47.985171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:47.985934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:57:47.986339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:47.988239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.000408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:48.009048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1055/2090] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:57:48.013797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.025006 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2522be4-9e91-492e-976a-54a0a77b57d0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.031016 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.032621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.032985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.033352 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.034713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.037494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.083220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1036/2091] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:57:48 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:57:48.087136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.098841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b2c0-26fd-4170-9dda-cab4974c4428 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.197758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.198719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.199227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.200395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.201377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.203609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.229089 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1056/2092] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:57:48 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:57:48.233936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.246104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d44f1-d48b-4d7f-815b-75522af901e4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.251053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.251792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.252204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.252542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.253285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.254989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.269313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1037/2093] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:57:48.273580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.286007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8b73-f1e3-4533-84fe-0ed32a12b821 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.291109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.291844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.292235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.292604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.294582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.296619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050b4f2-72c7-403a-af1b-5d6f8fe403fe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.310403 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1057/2094] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:57:48.314374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.351920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770069a3-e629-4499-8f73-e511b6b35140 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.358217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.358940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.359252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.359602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] PATH_INFO: `/v3/projects/fbbdaaffb56f486d8cd84b5169bab27d/users/b3c22d1e5dca4d96ab00f4f8c905ae61/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.404246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbdaaffb56f486d8cd84b5169bab27d, user_id=b3c22d1e5dca4d96ab00f4f8c905ae61, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.407154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.423485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1038/2095] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:57:48 2022] PUT /identity/v3/projects/fbbdaaffb56f486d8cd84b5169bab27d/users/b3c22d1e5dca4d96ab00f4f8c905ae61/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:57:48.493396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4358-c5fc-43b0-80f1-8a4bcd9f5a2d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.493644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4358-c5fc-43b0-80f1-8a4bcd9f5a2d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.493923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4358-c5fc-43b0-80f1-8a4bcd9f5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.523808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-03ba4358-c5fc-43b0-80f1-8a4bcd9f5a2d None None] MFA Rules not processed for user `b3c22d1e5dca4d96ab00f4f8c905ae61`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:48.525018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-03ba4358-c5fc-43b0-80f1-8a4bcd9f5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:48.606692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1058/2096] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:48.618480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:48.620782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:48.686724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948930-8c05-4330-ab75-cbc6e1ca2294 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:48.693312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:48.693987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:48.694831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:48.694831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:48.708772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:48.710646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e986679-e7e0-4092-b5d5-14e1ac2b0b4f service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:48.728787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1039/2097] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:58.602686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:58.717122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=57 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:57:59.163801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3557ee-2bbe-4139-9eea-e4d7ea7d5ab4 None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.164154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3557ee-2bbe-4139-9eea-e4d7ea7d5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.164434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3557ee-2bbe-4139-9eea-e4d7ea7d5ab4 None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.166301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1059/2098] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:57:59.190181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.190181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.190181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.240977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:59.242557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.362957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088687e-565f-48f5-8da7-8fa374717e88 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.363310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088687e-565f-48f5-8da7-8fa374717e88 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.363640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088687e-565f-48f5-8da7-8fa374717e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.384500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1040/2099] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:57:59.390506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f088687e-565f-48f5-8da7-8fa374717e88 None None] MFA Rules not processed for user `c4b964bfee2345b1a929e752860c459c`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:59.391767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f088687e-565f-48f5-8da7-8fa374717e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.402538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:59.404382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.420835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c759c-2c3c-4867-b17a-db3b0217986d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:59.424660 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b73010bdce438b846bd93f8a511634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:59.425310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.425587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.425930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.436746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:59.438210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28213d-3b5d-456a-9c23-dd522ae2e018 service glance] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:59.450100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1041/2100] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:59.464083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1060/2101] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:57:59.521663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.521975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.522248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.523804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1042/2102] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:57:59.529138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68731a-16cb-490c-89d3-6429eedf2c1c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.529611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68731a-16cb-490c-89d3-6429eedf2c1c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.529948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68731a-16cb-490c-89d3-6429eedf2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.553428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6b68731a-16cb-490c-89d3-6429eedf2c1c None None] MFA Rules not processed for user `adb92f3a165d47daa47b9de4707b1792`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:59.554732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6b68731a-16cb-490c-89d3-6429eedf2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.613923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1061/2103] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 17:57:59.626211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:59.628356 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.642147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099d456-b17b-45b1-a0d0-4858ae556b76 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:59.646166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:59.646753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.647027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.647317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.654727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:59.656203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e5ece-9cea-4175-80f2-a042a26126ec service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:59.664498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1043/2104] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:57:59.758768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76e10-1290-4eb4-857e-ff9145eca4cb None None] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.759049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76e10-1290-4eb4-857e-ff9145eca4cb None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.759370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76e10-1290-4eb4-857e-ff9145eca4cb None None] PATH_INFO: `/` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.760976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1062/2105] 10.222.0.26 () {54 vars in 921 bytes} [Fri Oct 14 17:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 17:57:59.767176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.768757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.769263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.793829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] MFA Rules not processed for user `fa4114e2020f4135bb6220c7e3aedc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:57:59.795113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:57:59.811478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1044/2106] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Oct 14 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:57:59.822270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db76e10-1290-4eb4-857e-ff9145eca4cb None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:57:59.834607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db76e10-1290-4eb4-857e-ff9145eca4cb None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:57:59.838187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:57:59.838778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:57:59.839058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:57:59.839405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:57:59.850213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:57:59.851670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7093e6-3fbe-4695-b148-c046e1465245 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:57:59.863560 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1063/2107] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:58:00.801381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:00.812126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadae21-fb3a-452b-a50c-9853066fc9ab None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:00.815834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:00.816483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:00.816786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:00.817091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:00.818895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:00.899867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:00.901399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:00.911662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1045/2108] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:04.267771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:04.268318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:04.268405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:04.289128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:04.290471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:04.350303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1064/2109] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 17:58:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:04.368862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:04.370390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:04.433716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:04.472432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45b65-39f9-4321-b7eb-ca9973f0c999 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:04.488036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:04.488668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:04.489078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:04.489478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:04.523920 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:04.525630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf1e81-278e-46dd-9949-ac3a6f2ab21c service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:04.569409 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1046/2110] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:58:13.694572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:13.745007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:13.766413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59805c-d6d0-46c2-a499-c9a10b276d36 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:13.772734 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:13.773634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:13.773953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:13.774261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] PATH_INFO: `/v3/users/b3c22d1e5dca4d96ab00f4f8c905ae61` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:13.775634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c22d1e5dca4d96ab00f4f8c905ae61)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:13.778812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:13.829671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c22d1e5dca4d96ab00f4f8c905ae61'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:13.830493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c22d1e5dca4d96ab00f4f8c905ae61'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:13.837848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c22d1e5dca4d96ab00f4f8c905ae61'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:13.842238 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c22d1e5dca4d96ab00f4f8c905ae61'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:13.850698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c22d1e5dca4d96ab00f4f8c905ae61'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:13.874749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1065/2111] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:58:13 2022] DELETE /identity/v3/users/b3c22d1e5dca4d96ab00f4f8c905ae61 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:58:13.879448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:13.880010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:13.880124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:13.901036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:13.902847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:13.981909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1047/2112] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:13.991505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:13.993411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:14.059131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035634-a60f-4c00-9b8f-6c3ecf428a48 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:14.064546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:14.065545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.066077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.066709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.084477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:14.086002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45497ab-e7dc-48be-888e-dc5dbc036d3e service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:14.101287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1066/2113] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:14.549954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:14.559691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:14.580498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864e7b-b3e0-4a64-8308-792aa5b86075 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:14.590878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:14.591558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.591836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.592099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] PATH_INFO: `/v3/projects/fbbdaaffb56f486d8cd84b5169bab27d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.593224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbdaaffb56f486d8cd84b5169bab27d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:14.595350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:14.658550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbdaaffb56f486d8cd84b5169bab27d', 'request_id': 'req-52328daf-816f-42fb-a787-9f67d6fa463b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:14.665064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbdaaffb56f486d8cd84b5169bab27d', 'request_id': 'req-52328daf-816f-42fb-a787-9f67d6fa463b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:14.673674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbdaaffb56f486d8cd84b5169bab27d', 'request_id': 'req-52328daf-816f-42fb-a787-9f67d6fa463b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:14.685388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] The token cache is being invalidate because project fbbdaaffb56f486d8cd84b5169bab27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:58:14.685697 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:14.686360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-52328daf-816f-42fb-a787-9f67d6fa463b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:14.691794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1048/2114] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:58:14 2022] DELETE /identity/v3/projects/fbbdaaffb56f486d8cd84b5169bab27d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:58:14.695096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.695650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.695650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.716735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:14.717923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:14.796640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1067/2115] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:14.798543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.798827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.799092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.821342 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:14.822599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:14.833793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1049/2116] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:14.838592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:14.849474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2ee1-3b54-4bf9-a522-bb80b381b002 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:14.867760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:14.868390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.868679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.868946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.869616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:58:14.869918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:14.872396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:14.876742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:14.892671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1068/2117] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:58:14.896760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:14.906704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d88d14-7477-43ee-89e8-2da2d8bae729 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:14.911351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:14.911961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:14.912230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:14.912594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:14.913117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:14.915013 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:14.944416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1050/2118] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:58:14 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:58:14.949062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:14.969345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a121d7-4c70-4972-b9d3-6b2ec99a617b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:15.034584 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:15.035468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.035953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.036340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.037255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:15.039539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:15.064040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1069/2119] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:58:14 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 17:58:15.068224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:15.080089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0951-6e70-4183-95e1-dcef5badbefb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:15.085410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:15.086031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.086315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.086708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.087403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:15.089072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:15.099953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1051/2120] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:58:15.103913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:15.113931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34028-04fd-4fe1-a0e6-7e07e39fff8d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:15.121625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:15.122237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.122618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.122780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.123454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:15.125769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e65e2b-f12c-405a-be0a-d3d32168fa90 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:15.141407 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1070/2121] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:58:15.142745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:15.153587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04afcf-6ef3-4757-a454-8a70b533431a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:15.158800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:15.159522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.159802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.160105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] PATH_INFO: `/v3/projects/3379894b6bdd471eadaea353e1221900/users/079ad5ec3e1d4b1eb6e3fcc8e5faafa4/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.178595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3379894b6bdd471eadaea353e1221900, user_id=079ad5ec3e1d4b1eb6e3fcc8e5faafa4, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:15.181458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:15.195159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1052/2122] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:58:15 2022] PUT /identity/v3/projects/3379894b6bdd471eadaea353e1221900/users/079ad5ec3e1d4b1eb6e3fcc8e5faafa4/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:58:15.206680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.206967 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.207242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.236572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] MFA Rules not processed for user `079ad5ec3e1d4b1eb6e3fcc8e5faafa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:15.237868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:15.320154 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1071/2123] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:15.331791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:15.333478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:15.338689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:15.402094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80480-dd9b-410f-bf3e-d4caeb390ceb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:15.405912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:15.406744 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:15.407087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:15.407455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:15.418266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:15.419138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07098-6d93-4a17-b1c9-fa1e73323dc0 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:15.429263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1053/2124] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:20.270020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:20.271660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:20.349536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528e08f-48c8-4236-b369-325992d84bfa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:20.356292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:20.356908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:20.357188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:20.357855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:20.359682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:20.368036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:20.373134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:20.375380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:20.385361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1072/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:24.068169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbe58-c3a5-405a-b3c7-bc7acce7a37f None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:24.068648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbe58-c3a5-405a-b3c7-bc7acce7a37f None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:24.068733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbe58-c3a5-405a-b3c7-bc7acce7a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:24.093808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2f5dbe58-c3a5-405a-b3c7-bc7acce7a37f None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:24.095050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2f5dbe58-c3a5-405a-b3c7-bc7acce7a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:24.178772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1054/2126] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 17:58:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:24.203113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:24.204557 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:24.275785 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2576-3553-4131-9d17-58a1fc8ea2b8 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:24.281253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:24.281840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:24.282116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:24.282384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:24.290304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:24.292546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:24.300561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1073/2127] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 17:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 17:58:31.229282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8325-8c58-407f-ace7-25012f5c8f9e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:31.229713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8325-8c58-407f-ace7-25012f5c8f9e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:31.229875 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c8325-8c58-407f-ace7-25012f5c8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:31.249378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b70c8325-8c58-407f-ace7-25012f5c8f9e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:31.250589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b70c8325-8c58-407f-ace7-25012f5c8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:31.324784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1055/2128] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:31.345002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:31.346467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:31.428049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588f35a-81fa-4a6a-9dc2-45f613e58647 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:31.434662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:31.435388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:31.435667 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:31.435940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:31.445689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:31.447369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:31.459145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1074/2129] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:34.569357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b69e00-654a-4402-be76-73ccbd7d9b98 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:34.569994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b69e00-654a-4402-be76-73ccbd7d9b98 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:34.569994 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b69e00-654a-4402-be76-73ccbd7d9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:34.594502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a9b69e00-654a-4402-be76-73ccbd7d9b98 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:34.595735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a9b69e00-654a-4402-be76-73ccbd7d9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:34.604504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1056/2130] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:34.617752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:34.619534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:34.637729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3312-b460-4deb-ba02-8b9d596094f4 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:34.643384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:34.644025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:34.644301 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:34.644572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:34.655110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:34.656775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:34.668599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1075/2131] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:37.631593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259f60-c5dd-43af-82f9-e037f167d334 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:37.632096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259f60-c5dd-43af-82f9-e037f167d334 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:37.632186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259f60-c5dd-43af-82f9-e037f167d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:37.652768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-de259f60-c5dd-43af-82f9-e037f167d334 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:37.653942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-de259f60-c5dd-43af-82f9-e037f167d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:37.661673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1057/2132] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:37.678026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:37.689873 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fee92b-5925-48eb-bc12-da252399c191 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:37.695705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:37.696368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:37.696712 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:37.696984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:37.706834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:37.708427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:37.718335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1076/2133] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 17:58:42.912928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af338db-fe27-4919-815a-b490a39819d7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:42.913533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af338db-fe27-4919-815a-b490a39819d7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:42.913533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af338db-fe27-4919-815a-b490a39819d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:42.944711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8af338db-fe27-4919-815a-b490a39819d7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:42.946606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8af338db-fe27-4919-815a-b490a39819d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:42.962827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1058/2134] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:42.982124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:42.997795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd41e-176d-43a1-8280-03446b157d81 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:43.004703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:43.005538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:43.005818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:43.006295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:43.016160 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:43.017972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f60900-10b8-45e0-9f37-edef60c6ef9f service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:43.041897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1077/2135] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:46.276338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:46.276938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:46.277061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:46.285084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=87 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:46.298608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] MFA Rules not processed for user `6a5d2cb64aa841d0b3303581aaf3d36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:46.299839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:46.360053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1059/2136] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:47.092197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:47.092715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:47.092855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:47.113095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:47.114317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:47.123937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1078/2137] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Oct 14 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:47.141106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:47.154399 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3ecac-ffc3-4f06-95bb-f4b43248f0b6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:47.159851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:47.160542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:47.160824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:47.161093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:47.169705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:47.171541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629283-35a4-4019-a1dd-5b15b7e37957 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:47.182173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1060/2138] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:48.682917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:48.692887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fc729-213d-46e5-bc1c-c5ecd9431238 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:48.697542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:48.698297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:48.698576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:48.698846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] PATH_INFO: `/v3/users/079ad5ec3e1d4b1eb6e3fcc8e5faafa4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:48.699994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=079ad5ec3e1d4b1eb6e3fcc8e5faafa4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:48.701902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:48.718646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:48.748343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079ad5ec3e1d4b1eb6e3fcc8e5faafa4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:48.748982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079ad5ec3e1d4b1eb6e3fcc8e5faafa4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:48.755759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079ad5ec3e1d4b1eb6e3fcc8e5faafa4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:48.756384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079ad5ec3e1d4b1eb6e3fcc8e5faafa4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:48.763520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079ad5ec3e1d4b1eb6e3fcc8e5faafa4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:48.780844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1079/2139] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:58:48 2022] DELETE /identity/v3/users/079ad5ec3e1d4b1eb6e3fcc8e5faafa4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:58:48.785281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:48.785753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:48.785850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:48.804880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:58:48.806069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:48.866043 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1061/2140] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:58:48.875676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:48.877093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:48.944779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1737e5-c0d8-49fb-b3a6-7b5fce1387ac admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:48.948448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:48.949049 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:48.949343 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:48.949593 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:48.958633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:48.960078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b28a9-391c-425e-8739-1bdf3f32fc2b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:48.969551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1080/2141] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:58:49.332550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:58:49.334235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:58:49.347014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f120-3f5c-48f3-803e-f94c3a19095e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:58:49.352894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:58:49.353867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:58:49.354246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:58:49.354635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] PATH_INFO: `/v3/projects/3379894b6bdd471eadaea353e1221900` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:58:49.356100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3379894b6bdd471eadaea353e1221900)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:58:49.358645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:58:49.412304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3379894b6bdd471eadaea353e1221900', 'request_id': 'req-decb67d2-16de-4f42-8c0c-40eb0f9b2982'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:49.419487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3379894b6bdd471eadaea353e1221900', 'request_id': 'req-decb67d2-16de-4f42-8c0c-40eb0f9b2982'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:49.427552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3379894b6bdd471eadaea353e1221900', 'request_id': 'req-decb67d2-16de-4f42-8c0c-40eb0f9b2982'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:49.439233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] The token cache is being invalidate because project 3379894b6bdd471eadaea353e1221900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:58:49.439572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:49.440209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-decb67d2-16de-4f42-8c0c-40eb0f9b2982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:58:49.441703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1062/2142] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:58:49 2022] DELETE /identity/v3/projects/3379894b6bdd471eadaea353e1221900 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:58:58.965214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:58:59.436233 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:07.669402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:07.669971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:07.669971 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:07.689572 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] MFA Rules not processed for user `5cd61d7e706d46c6992c7abbbfc4b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:07.691041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:07.761286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1081/2143] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:16.973801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:16.974320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:16.974320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:16.994323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] MFA Rules not processed for user `57705b9fa1544050b59d5bf298d66931`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:16.995534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:17.050022 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1063/2144] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:17.752903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=25 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:17.818137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:17.820054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:17.911299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6260a30-974a-4787-9eba-4a5078ba5c1a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:17.917056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:17.917777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:17.918123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:17.918468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] PATH_INFO: `/v3/users/c4b964bfee2345b1a929e752860c459c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:17.919764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b964bfee2345b1a929e752860c459c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:17.921902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:17.972844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b964bfee2345b1a929e752860c459c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:17.973609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b964bfee2345b1a929e752860c459c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:17.981409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b964bfee2345b1a929e752860c459c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:17.982077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b964bfee2345b1a929e752860c459c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:17.990107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-2d35b257-e8aa-4eb8-b874-ec4a9641fa7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b964bfee2345b1a929e752860c459c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.009660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1082/2145] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:59:17 2022] DELETE /identity/v3/users/c4b964bfee2345b1a929e752860c459c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 17:59:18.188556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.212612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187eae5-1830-4227-b5f2-85323ac86532 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.292285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.293616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.293967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.294306 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] PATH_INFO: `/v3/projects/0f140583d4954c32898e73f2c3d95e8d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.295562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f140583d4954c32898e73f2c3d95e8d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.297743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.358202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f140583d4954c32898e73f2c3d95e8d', 'request_id': 'req-d618f6ef-2bb6-466c-a678-10103675066e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.365224 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f140583d4954c32898e73f2c3d95e8d', 'request_id': 'req-d618f6ef-2bb6-466c-a678-10103675066e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.373696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f140583d4954c32898e73f2c3d95e8d', 'request_id': 'req-d618f6ef-2bb6-466c-a678-10103675066e'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.395542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] The token cache is being invalidate because project 0f140583d4954c32898e73f2c3d95e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:59:18.395836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.396502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d618f6ef-2bb6-466c-a678-10103675066e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:18.398050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1064/2146] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:59:18 2022] DELETE /identity/v3/projects/0f140583d4954c32898e73f2c3d95e8d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:59:18.403209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.403875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.404156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.425339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:18.426702 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:18.500365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1083/2147] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:18.507967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.508314 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.508621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.529273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:18.530469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:18.540682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1065/2148] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:18.544470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.555046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db351c-fcc3-46dd-84b2-52c7b462e8cc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.561082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.561675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.561951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.562219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.562884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 17:59:18.563376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.564981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.577652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1084/2149] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 17:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 17:59:18.582236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.592545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884f4d-f432-4ff6-b487-3f20af97b4ed None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.597258 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.597862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.598143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.598420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.599050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.601693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.633518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1066/2150] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 17:59:18 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:59:18.637823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.648086 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f660c01-1ae4-4121-a78e-62a64aed96a8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.652353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:18.711034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.712250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.712521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.712804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.713427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.715536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.739476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1085/2151] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 17:59:18 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 17:59:18.744294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.754978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f73e3-75cd-4aaa-8729-f47130c2d958 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.759740 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.760463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.760743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.761009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.761678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.763250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.764823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:18.779451 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1067/2152] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 17:59:18.780938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.791618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d234-2c92-4eef-b10d-9c10d54d36c2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.796334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.797085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.797431 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.797852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.798719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.800525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f07451-616e-4f0c-b580-6aa725be6862 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.812333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1086/2153] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 17:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 17:59:18.816773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.827851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101eec-4fe0-4b91-a3b0-7a915e11cd13 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:18.833670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:18.834683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.834925 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.835303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] PATH_INFO: `/v3/projects/b8e441d2fbb848e8991a871862d2d573/users/e6508d26182b4f39b4ea723282d83ed8/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.850683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e441d2fbb848e8991a871862d2d573, user_id=e6508d26182b4f39b4ea723282d83ed8, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:18.854157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:18.866711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1068/2154] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 17:59:18 2022] PUT /identity/v3/projects/b8e441d2fbb848e8991a871862d2d573/users/e6508d26182b4f39b4ea723282d83ed8/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:59:18.878228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:18.878537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:18.878811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:18.908558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] MFA Rules not processed for user `e6508d26182b4f39b4ea723282d83ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:18.909763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:18.975578 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1087/2155] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:18.987026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:18.988808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:19.052968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c1e-be84-442b-95b2-d80ea04b9dfd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:19.057282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:19.057965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:19.058329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:19.058662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:19.071417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:19.073049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93933017-64f2-45ab-92e5-464d19ca1d8e service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:19.083322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1069/2156] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:59:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:59:28.973650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:29.078375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:29.157521 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:29.224272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f277d5-9ee6-4d61-aa53-ac6927afc76f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:29.229633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:29.230279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:29.230552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:29.230818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] PATH_INFO: `/v3/users/e6508d26182b4f39b4ea723282d83ed8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:29.231975 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6508d26182b4f39b4ea723282d83ed8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:29.233908 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:29.285963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6508d26182b4f39b4ea723282d83ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:29.286633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6508d26182b4f39b4ea723282d83ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:29.294993 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6508d26182b4f39b4ea723282d83ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:29.295798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6508d26182b4f39b4ea723282d83ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:29.305098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6508d26182b4f39b4ea723282d83ed8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:29.324012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1088/2157] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 17:59:29 2022] DELETE /identity/v3/users/e6508d26182b4f39b4ea723282d83ed8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:59:29.328449 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:29.328733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:29.329001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:29.348846 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 17:59:29.350055 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:29.414853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1070/2158] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 17:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 17:59:29.434124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:29.435605 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:29.497960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d1acd-abd3-49ae-931a-28b92f1d3e24 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:29.501846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:29.502565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:29.503428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:29.503428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:29.513479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:29.514907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2418b-edd9-4fb6-a1f0-a9ba0c97d08b service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:29.525030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1089/2159] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 17:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 17:59:29.924670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 17:59:29.926719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 17:59:29.940195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce444b-0c1a-4be0-8914-16d67d79a4df None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 17:59:29.946017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 17:59:29.946908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 17:59:29.947255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 17:59:29.947574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] PATH_INFO: `/v3/projects/b8e441d2fbb848e8991a871862d2d573` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 17:59:29.948838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e441d2fbb848e8991a871862d2d573)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 17:59:29.950954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 17:59:30.012408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e441d2fbb848e8991a871862d2d573', 'request_id': 'req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:30.020666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e441d2fbb848e8991a871862d2d573', 'request_id': 'req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:30.032048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e441d2fbb848e8991a871862d2d573', 'request_id': 'req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:30.044664 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] The token cache is being invalidate because project b8e441d2fbb848e8991a871862d2d573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 17:59:30.045080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:30.045849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 17:59:30.047793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1071/2160] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 17:59:29 2022] DELETE /identity/v3/projects/b8e441d2fbb848e8991a871862d2d573 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 17:59:39.520739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 17:59:40.040340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:02.266418 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680818-2841-42e6-86ea-7ee7f9474e8c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:02.266940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680818-2841-42e6-86ea-7ee7f9474e8c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:02.267101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680818-2841-42e6-86ea-7ee7f9474e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:02.288456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-47680818-2841-42e6-86ea-7ee7f9474e8c None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:02.290492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-47680818-2841-42e6-86ea-7ee7f9474e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:02.359761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1090/2161] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 18:00:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:02.415646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:02.417775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:02.498336 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2b41e-bcd3-4ad0-9546-c6f69ec0d488 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:02.503303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:02.503922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:02.504201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:02.504470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:02.513584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:02.515172 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:02.524176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1072/2162] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:00:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:07.189477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:07.190044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:07.190044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:07.210755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] MFA Rules not processed for user `6a5d2cb64aa841d0b3303581aaf3d36b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:07.211987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:07.270378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1091/2163] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:11.254591 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:11.256800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:11.339969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b44d8-9a07-4318-93c2-952405d620fa service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:11.346613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:11.347498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:11.347987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:11.349112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] PATH_INFO: `/v3/users/1f973db8e45745a6bb69a540d4f422d4` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:11.350812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f973db8e45745a6bb69a540d4f422d4)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:11.353861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:11.436149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f973db8e45745a6bb69a540d4f422d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.437128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f973db8e45745a6bb69a540d4f422d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.449981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f973db8e45745a6bb69a540d4f422d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.450869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f973db8e45745a6bb69a540d4f422d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.462162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f973db8e45745a6bb69a540d4f422d4'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.488549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1073/2164] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:00:11 2022] DELETE /identity/v3/users/1f973db8e45745a6bb69a540d4f422d4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:11.678776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:11.701762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c16c-940a-4899-a0d5-56f2c18ded73 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:11.765324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:11.765957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:11.766233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:11.766502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] PATH_INFO: `/v3/projects/0562fec8a7404f6aa4cf476a162cfba7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:11.767728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0562fec8a7404f6aa4cf476a162cfba7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:11.769681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:11.819655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0562fec8a7404f6aa4cf476a162cfba7', 'request_id': 'req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.822506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:11.829448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0562fec8a7404f6aa4cf476a162cfba7', 'request_id': 'req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.837849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0562fec8a7404f6aa4cf476a162cfba7', 'request_id': 'req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.848568 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] The token cache is being invalidate because project 0562fec8a7404f6aa4cf476a162cfba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:00:11.848849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.849515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:11.851159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1092/2165] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:00:11 2022] DELETE /identity/v3/projects/0562fec8a7404f6aa4cf476a162cfba7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:00:11.855180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:11.856706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:11.870119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9dcb9-bb41-4546-87ff-62154ad919a4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:11.875205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:11.935657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:11.936264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:11.936549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:11.936818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] PATH_INFO: `/v3/users/a144ced1439843beb57cb6134348e70d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:11.937973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a144ced1439843beb57cb6134348e70d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:11.940165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:11.999826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a144ced1439843beb57cb6134348e70d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.000483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a144ced1439843beb57cb6134348e70d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.007894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a144ced1439843beb57cb6134348e70d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.008546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a144ced1439843beb57cb6134348e70d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.016012 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a144ced1439843beb57cb6134348e70d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.035882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1074/2166] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:00:11 2022] DELETE /identity/v3/users/a144ced1439843beb57cb6134348e70d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:12.237341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:12.239026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:12.252619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba01a-0eb4-4c2d-b277-24e3df9bb61e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:12.310844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:12.311503 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:12.311780 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:12.312051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] PATH_INFO: `/v3/projects/b8723dc11420421087e696576a777566` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:12.313155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8723dc11420421087e696576a777566)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:12.315043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:12.360720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8723dc11420421087e696576a777566', 'request_id': 'req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.368414 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8723dc11420421087e696576a777566', 'request_id': 'req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.374791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8723dc11420421087e696576a777566', 'request_id': 'req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.385840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] The token cache is being invalidate because project b8723dc11420421087e696576a777566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:00:12.386126 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.386755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:12.388331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1093/2167] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:00:12 2022] DELETE /identity/v3/projects/b8723dc11420421087e696576a777566 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:12.721962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:12.723483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:12.778737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0569-7551-43d9-a71a-bee9cc7d0a40 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:12.820120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:12.828543 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:12.829341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:12.829771 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:12.830510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:12.832307 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:12.901534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:12.902889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:12.914378 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1075/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:15.305341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:15.307031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:15.329250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068e86-ee1b-42a3-b1bd-829223ed7b8f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:15.336969 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:15.338030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:15.338030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:15.338380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:15.341095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:15.358258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:15.359877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:15.373463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1094/2169] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 18:00:17.626649 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:17.635887 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9ba5-4d11-4cfe-ad25-df6d42a01c2c service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:17.639689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:17.640393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:17.640721 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:17.641059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:17.642976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:17.714769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:17.716244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:17.726775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1076/2170] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:21.423814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:21.425409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:21.441322 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ad6d3-92c3-4345-9ec1-c8d063b915a6 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:21.447867 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:21.448762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:21.449129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:21.449471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] PATH_INFO: `/v3/users/5cd61d7e706d46c6992c7abbbfc4b094` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:21.450693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd61d7e706d46c6992c7abbbfc4b094)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:21.452738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:21.504438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd61d7e706d46c6992c7abbbfc4b094'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.505123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd61d7e706d46c6992c7abbbfc4b094'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.510037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:21.513966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd61d7e706d46c6992c7abbbfc4b094'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.514796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd61d7e706d46c6992c7abbbfc4b094'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.523251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-bee84336-0ca1-4c15-bc33-3e4b6fd62daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd61d7e706d46c6992c7abbbfc4b094'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.541272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1095/2171] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:00:21 2022] DELETE /identity/v3/users/5cd61d7e706d46c6992c7abbbfc4b094 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:21.723514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:21.735787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1760b-c930-450a-9620-f07b79c449f3 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:21.812425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:21.813284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:21.813619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:21.814185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] PATH_INFO: `/v3/projects/c971b9fa064e42168b9a976f4fea642d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:21.815620 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c971b9fa064e42168b9a976f4fea642d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:21.817944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:21.845177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:21.876394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c971b9fa064e42168b9a976f4fea642d', 'request_id': 'req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.884315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c971b9fa064e42168b9a976f4fea642d', 'request_id': 'req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.894606 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c971b9fa064e42168b9a976f4fea642d', 'request_id': 'req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.909244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] The token cache is being invalidate because project c971b9fa064e42168b9a976f4fea642d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:00:21.909581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.910165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-5dbd01fb-30d2-412f-b0e0-41070a5a5a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:00:21.911677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1077/2172] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:00:21 2022] DELETE /identity/v3/projects/c971b9fa064e42168b9a976f4fea642d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:21.916664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:21.916949 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:21.917219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:21.936699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:21.937891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:21.999670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1096/2173] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:22.007686 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.007970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.008242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.028516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:22.029731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:22.037810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1078/2174] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:22.041796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.051147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c126a-ae62-48dc-b71d-0769813fbee1 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.055632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.056212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.056484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.056748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.057382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:00:22.057679 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.059253 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.071114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1097/2175] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:00:22.074957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.085140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc7df-4d65-4c2f-a6e1-36fc1d6f4051 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.089932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.090518 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.090793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.091061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.091726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.093630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.120520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1079/2176] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:00:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:00:22.124384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.135193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f8c7a-5558-4033-801f-93c9c50772f0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.191851 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.192760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.193658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.194017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.194751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.196685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.224839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1098/2177] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:00:22 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:00:22.226504 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.237539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9cbc-b81e-4f04-84e5-8fa884c65d17 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.242223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.243001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.243375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.243706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.244511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.246178 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.257198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1080/2178] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:00:22.261469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.272229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3e070-ce11-4b32-9ec8-43efadb41cd7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.277272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.277931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.278293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.278624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.279354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.280997 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6c9e-e47c-454d-a65d-c842f456427d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.295570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1099/2179] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:00:22.297057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.308349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26593d-7c84-4ed6-951e-319e63653816 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.313207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.313856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.314132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.314519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] PATH_INFO: `/v3/projects/5d028c23f7594abbbf9fdf20a1f02850/users/43fbd8e4b0bd4ab7ba7aeb602ba0a693/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.329468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d028c23f7594abbbf9fdf20a1f02850, user_id=43fbd8e4b0bd4ab7ba7aeb602ba0a693, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.332454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.345791 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1081/2180] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:00:22 2022] PUT /identity/v3/projects/5d028c23f7594abbbf9fdf20a1f02850/users/43fbd8e4b0bd4ab7ba7aeb602ba0a693/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:00:22.351264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.351640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.351918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.370394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:22.371661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:22.401631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:22.432106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1100/2181] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:22.441637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:22.443396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:22.501002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb90b3-2c7b-4a5c-a8eb-0dd2e3a8f3e4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:22.504635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:22.505244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:22.505517 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:22.505812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:22.514559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:22.516009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf07ce-9e9a-435b-b305-daed3f0077bd service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:22.525762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1082/2182] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:23.055884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:23.057393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:23.069636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e6c5-92b9-44b0-a536-38ec67ca3c76 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:23.073250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:23.073926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:23.074276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:23.074535 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:23.076386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:23.150950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:23.152913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:23.162838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1101/2183] 10.222.0.26 () {60 vars in 1396 bytes} [Fri Oct 14 18:00:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:27.109287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:27.109758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:27.109894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:27.139257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] MFA Rules not processed for user `43fbd8e4b0bd4ab7ba7aeb602ba0a693`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:27.140735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:27.183685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:27.212011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1083/2184] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:27.227010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:27.228588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:27.300288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97de428-72b2-480f-9c1b-f599274342f7 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:27.311224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:27.312739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:27.313026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:27.313297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:27.322891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:27.324533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e827492-8c95-4716-9ab5-92ce7a52c81e service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:27.335662 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1102/2185] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:28.515584 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:28.531537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653ce04-a767-4ace-a797-9367040aa194 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:28.541662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:28.542285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:28.542804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:28.543270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:28.545416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:28.616736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:28.618380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f21af-8a8c-4114-bc3d-fa3f4910aa0e service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:28.628418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1084/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:28.985890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:28.986453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:28.986453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:29.009774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] MFA Rules not processed for user `43fbd8e4b0bd4ab7ba7aeb602ba0a693`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:29.011009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:29.018471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1103/2187] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:00:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:35.406694 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:35.407681 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:35.407948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:35.428372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:35.429570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:35.491002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1085/2188] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 18:00:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:35.504739 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:35.507008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:35.560585 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:35.578533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936998-2fdf-4913-8c04-0ea301c0f534 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:35.584338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:35.584939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:35.585218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:35.585490 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:35.594125 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:35.595749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:35.603883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1104/2189] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:00:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:00:45.478830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=63 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:45.600729 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:00:45.708248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:45.717542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d74bc8-af93-49e4-991b-55d50681e031 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:45.721184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:45.721777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:45.722053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:45.722321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:45.724149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:45.733452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:45.734866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e777c7-467e-4e70-a079-23987dca3732 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:45.743512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1086/2190] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:49.095401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:49.104877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624258e-e51c-4174-9407-8a05348b7ec5 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:49.108437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:49.109015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:49.109295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:49.109567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:49.111247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:49.120790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:49.122143 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c49ea-ec53-4125-b94e-287c6d1dafb9 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:49.130818 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1105/2191] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:49.434132 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329f39-bd12-48c7-b121-a8a529151aa3 None None] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:49.434536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329f39-bd12-48c7-b121-a8a529151aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:49.434759 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329f39-bd12-48c7-b121-a8a529151aa3 None None] PATH_INFO: `/` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:49.436126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1087/2192] 10.222.0.26 () {54 vars in 961 bytes} [Fri Oct 14 18:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 18:00:49.440869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28b4-c042-423d-9a35-1722162b9104 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:49.441145 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28b4-c042-423d-9a35-1722162b9104 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:49.441411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28b4-c042-423d-9a35-1722162b9104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:49.461266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-278d28b4-c042-423d-9a35-1722162b9104 None None] MFA Rules not processed for user `233bd3bd3a8f4d8484a6873a61cab231`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:49.462437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-278d28b4-c042-423d-9a35-1722162b9104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:49.527905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1106/2193] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Oct 14 18:00:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:49.535398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329f39-bd12-48c7-b121-a8a529151aa3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:49.548377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329f39-bd12-48c7-b121-a8a529151aa3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:49.553801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:49.554384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:49.554656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:49.554918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:49.556616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:49.568175 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:49.569728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:49.579392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1088/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:00:51.200533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:51.200988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:51.201085 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:51.220182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:00:51.221388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:00:51.229030 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1107/2195] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 18:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:00:51.241513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:00:51.252562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d5bd8-a5aa-41fc-bcd1-523c98e81f9d service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:00:51.258066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:00:51.258658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:00:51.258922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:00:51.259188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:00:51.267040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:00:51.268640 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8ea15-961d-4362-b581-2ba8b73328c8 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:00:51.277084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1089/2196] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:01.215462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=38 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:01.273801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=18 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:06.046191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:06.048242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:06.071875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962e013-dd1b-423e-b7fc-d8cdaa94f84e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:06.077699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:06.078340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:06.078619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:06.078890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:06.080964 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:06.094038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:06.095730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:06.106298 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1108/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:08.678137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:08.678610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:08.678707 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:08.699728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:08.700921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:08.708818 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1090/2198] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:08.730462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:08.741684 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53bb5-997c-4d2a-810b-8672dde4befa service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:08.746624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:08.747205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:08.747507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:08.747775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:08.756340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:08.757881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:08.765795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1109/2199] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:01:10.250736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:10.268134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07db623-a18b-4839-a98e-1a8d376ac093 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:10.276802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:10.277984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:10.278442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:10.278704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:10.280798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:10.294547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:10.296232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:10.309594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1091/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:16.096859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:16.106227 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02b3f-db7a-453f-8f78-8eaf8a474739 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:16.109819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:16.110409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:16.110687 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:16.110959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:16.112722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:16.124246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:16.125649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:16.135738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1110/2201] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:19.431217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:19.437734 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:19.456247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336732e-55d1-4474-a56c-0c3686b008b6 service nova] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:19.471098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:19.472029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:19.472303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:19.472568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:19.475035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:19.492301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:19.494335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:19.513154 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1092/2202] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:19.519822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:19.522117 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:19.536277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52e73a-b76e-4a75-8528-b53328647263 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:19.541134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:19.542158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:19.542494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:19.542797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] PATH_INFO: `/v3/users/6a5d2cb64aa841d0b3303581aaf3d36b` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:19.544555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5d2cb64aa841d0b3303581aaf3d36b)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:19.546642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:19.600488 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5d2cb64aa841d0b3303581aaf3d36b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.601180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5d2cb64aa841d0b3303581aaf3d36b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.608987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5d2cb64aa841d0b3303581aaf3d36b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.609715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5d2cb64aa841d0b3303581aaf3d36b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.618291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-6657dd14-3c32-4c8a-a312-37d641344d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5d2cb64aa841d0b3303581aaf3d36b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.636727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1111/2203] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:19 2022] DELETE /identity/v3/users/6a5d2cb64aa841d0b3303581aaf3d36b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:19.839716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:19.863884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750bbcc-2c47-4803-a898-2e990b5c4446 service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:19.935595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:19.936396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:19.936742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:19.937089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] PATH_INFO: `/v3/projects/fa98a9499c844aa0b9c87a7b6afc2443` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:19.939405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa98a9499c844aa0b9c87a7b6afc2443)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:19.941326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:19.992538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa98a9499c844aa0b9c87a7b6afc2443', 'request_id': 'req-074b430d-56be-4433-81da-665b1f1886bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:19.999423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa98a9499c844aa0b9c87a7b6afc2443', 'request_id': 'req-074b430d-56be-4433-81da-665b1f1886bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:20.008589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa98a9499c844aa0b9c87a7b6afc2443', 'request_id': 'req-074b430d-56be-4433-81da-665b1f1886bc'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:20.019521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] The token cache is being invalidate because project fa98a9499c844aa0b9c87a7b6afc2443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:20.019813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:20.020481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-074b430d-56be-4433-81da-665b1f1886bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:20.022107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1093/2204] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:19 2022] DELETE /identity/v3/projects/fa98a9499c844aa0b9c87a7b6afc2443 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:20.027541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.027941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.028282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.048058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:20.049335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:20.108415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1112/2205] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:20.116574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.116855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.117125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.136515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:20.137710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:20.145975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1094/2206] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:01:20.149936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.159970 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f16cc-3380-4ef6-b8dd-bf728cbdef1c None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.165625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.166210 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.166486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.166753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.167421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:20.167719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.169326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.182252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1113/2207] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:01:20.186470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.195954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d174c-46c7-4919-9187-3d50fb83bef7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.200826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.201527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.202023 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.202287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.203076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.205485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.234333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1095/2208] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:20 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:20.238708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.249329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7662-9d6f-497a-acde-2853db1369bb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.268821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:20.309042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.309645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.309925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.310194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.310827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.312776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.334484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1114/2209] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:20 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:20.338614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.349113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643ac5-7d12-453b-bce1-8ddfcb1309fc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.353652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.354239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.354511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.354774 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.355438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.357014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.366695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1096/2210] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:20.370412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.380882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07289f0-707b-47bc-acd8-1ca6a7773837 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.385660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.386242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.386518 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.386824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.387491 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.389066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abbc73-7323-4e88-b3d0-d859bfc68dbe admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.401268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1115/2211] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:20.405312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.415008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9397-4342-473a-b17e-7801651d8476 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.419541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.420174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.420447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.420712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] PATH_INFO: `/v3/projects/6e8ee0a9e6004adbb77792c125ae004a/users/dc79595fdefc49b3afdfe6b74f27df0f/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.435492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8ee0a9e6004adbb77792c125ae004a, user_id=dc79595fdefc49b3afdfe6b74f27df0f, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.438118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.440279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:20.453908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1097/2212] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:20 2022] PUT /identity/v3/projects/6e8ee0a9e6004adbb77792c125ae004a/users/dc79595fdefc49b3afdfe6b74f27df0f/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:20.464398 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.464953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.465225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.494524 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] MFA Rules not processed for user `dc79595fdefc49b3afdfe6b74f27df0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:20.495761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:20.557124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1116/2213] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:20.568236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:20.569873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:20.644298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46ee02-3d29-4fba-b0be-210f0d806e6a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:20.650351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:20.650949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:20.651230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:20.651532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:20.659163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:20.661384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fdaff-d6bf-40fc-8d64-1170b61397a3 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:20.670074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1098/2214] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:25.850787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:25.911843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea0eeb-48be-417c-9f7d-7519ae63dd0e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:25.916331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:25.916958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:25.917236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:25.917506 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] PATH_INFO: `/v3/users/dc79595fdefc49b3afdfe6b74f27df0f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:25.918622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc79595fdefc49b3afdfe6b74f27df0f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:25.920553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:25.954019 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:25.968834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc79595fdefc49b3afdfe6b74f27df0f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:25.969469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc79595fdefc49b3afdfe6b74f27df0f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:25.976202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc79595fdefc49b3afdfe6b74f27df0f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:25.976816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc79595fdefc49b3afdfe6b74f27df0f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:25.983764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc79595fdefc49b3afdfe6b74f27df0f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.001350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1117/2215] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:25 2022] DELETE /identity/v3/users/dc79595fdefc49b3afdfe6b74f27df0f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:26.006393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.006868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.006965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.025588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:26.026781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:26.083908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1099/2216] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:26.093565 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.094934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:26.154457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240224df-2d0c-4671-ae4c-4ede16e67aad admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.158180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.158776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.159055 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.159345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.169335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.170766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07010066-2c49-4fe2-b452-eb241235e35c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.181404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1118/2217] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:26.523294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.524830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:26.537351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05c4b2-ed34-4ddd-b73f-db38bd67f847 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.542034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.542657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.542930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.543201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] PATH_INFO: `/v3/projects/6e8ee0a9e6004adbb77792c125ae004a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.544349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8ee0a9e6004adbb77792c125ae004a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.546242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.601093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8ee0a9e6004adbb77792c125ae004a', 'request_id': 'req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.607538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8ee0a9e6004adbb77792c125ae004a', 'request_id': 'req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.616327 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8ee0a9e6004adbb77792c125ae004a', 'request_id': 'req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.629007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] The token cache is being invalidate because project 6e8ee0a9e6004adbb77792c125ae004a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:26.629856 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.630880 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ce04a4ad-6bd8-4dad-b3a7-f1f327c510f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:26.632912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1100/2218] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:26 2022] DELETE /identity/v3/projects/6e8ee0a9e6004adbb77792c125ae004a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:26.638697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.638984 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.639257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.658931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:26.660159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:26.724512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1119/2219] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:26.733388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.733670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.733937 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.742374 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:26.757566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:26.758746 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:26.766531 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1101/2220] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:26.771309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.781040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c25898-d824-4e23-ab14-19677d74d2e2 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.786170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.786772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.787047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.787342 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.787988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:26.788286 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.789865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.801950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1120/2221] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 18:01:26.806052 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.815015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1cdf4-2dd3-4b0c-9c03-74d9be8aedb3 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.819827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.820413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.820690 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.820959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.821587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.823506 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.849935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1102/2222] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:26 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:01:26.853979 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.864719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87bbc6-0663-4405-a5d2-c4b2c9d4696b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.897302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:26.922370 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.922966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.923246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.923552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.924189 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.926096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.947422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1121/2223] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:26 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:26.951486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.962202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b3e5-ca18-491b-a6ae-49bca3858711 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.966777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:26.967408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:26.967689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:26.967960 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:26.968594 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:26.970186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:26.980577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1103/2224] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:26.984320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:26.995246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e2957-e6f6-4860-938a-5740181416bd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:26.999933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.000512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.000788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.001056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.001688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.003296 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df422-2a13-4196-bf69-919ebca37acc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.013262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1122/2225] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:27.017437 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.027372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de0c4-9485-4583-99b8-398dc480ce1a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.031931 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.032569 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.032841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.033110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] PATH_INFO: `/v3/projects/f49a46029372401d8aefdb70c4402809/users/150d1469acb54f33a013af192497bb77/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.048134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49a46029372401d8aefdb70c4402809, user_id=150d1469acb54f33a013af192497bb77, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.050787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.064085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1104/2226] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:27 2022] PUT /identity/v3/projects/f49a46029372401d8aefdb70c4402809/users/150d1469acb54f33a013af192497bb77/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:27.074943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.075324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.075691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.104114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] MFA Rules not processed for user `150d1469acb54f33a013af192497bb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:27.105303 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:27.168302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1123/2227] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:27.172688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.233505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a967c04-377e-48db-8316-da22590754a6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.238054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.239192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.239623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.239895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.240512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.242438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.268381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1105/2228] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:27 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:27.273116 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.283665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73b98-40ea-44ab-b882-fbcb8527fe04 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.340790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.341393 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.341672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.341941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.342583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.344821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.369681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1124/2229] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:27 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:27.370827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.382322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281938-593c-4f37-a6a6-3b55727f10ed admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.387190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.387852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.388130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.388397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.389042 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.390627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.402192 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1106/2230] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:27.406339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.416530 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38254e-de2c-4bbd-b437-5975210f6fb6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.421278 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.421933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.422209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.422476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] PATH_INFO: `/v3/projects/fc11b24f95604a618c8dc170b2aca3c1/users/83198d13580142038171ade44d986c0b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.438101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc11b24f95604a618c8dc170b2aca3c1, user_id=83198d13580142038171ade44d986c0b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.440802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.457492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1125/2231] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:27 2022] PUT /identity/v3/projects/fc11b24f95604a618c8dc170b2aca3c1/users/83198d13580142038171ade44d986c0b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:27.461588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.471573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b0e3-9920-49c6-8ec4-77a58d9a57c3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.531323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.531927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.532202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.532469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.533101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.534683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84a78f-fc1f-46dc-b40e-755a38c6133c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.544827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1107/2232] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:27.549057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.559894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414f076-dafb-4bf9-b768-d9b4fe2d9452 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.564878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.565602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.565902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.566208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] PATH_INFO: `/v3/projects/fc11b24f95604a618c8dc170b2aca3c1/users/83198d13580142038171ade44d986c0b/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.568372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc11b24f95604a618c8dc170b2aca3c1, user_id=83198d13580142038171ade44d986c0b, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.571225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.577037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:27.583419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1126/2233] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:27 2022] PUT /identity/v3/projects/fc11b24f95604a618c8dc170b2aca3c1/users/83198d13580142038171ade44d986c0b/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:27.593711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.594045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.594346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.614898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:27.624487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] MFA Rules not processed for user `83198d13580142038171ade44d986c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:27.625698 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:27.692612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1108/2234] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:01:27.705054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:27.706723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:27.762787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822604-41bf-4dca-af13-203777c26cde admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:27.766270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:27.766863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:27.767135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:27.767435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:27.776124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:27.777536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad703c30-1379-4d1f-bba6-e57d942e2ca8 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:27.787092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1127/2235] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:29.114458 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:29.174582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3b7f2-fe21-4965-b155-fd90672730b5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:29.179589 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:29.180199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:29.180469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:29.180732 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] PATH_INFO: `/v3/users/150d1469acb54f33a013af192497bb77` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:29.181827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150d1469acb54f33a013af192497bb77)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:29.183767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:29.229718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150d1469acb54f33a013af192497bb77'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.230348 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150d1469acb54f33a013af192497bb77'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.237001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150d1469acb54f33a013af192497bb77'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.237605 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150d1469acb54f33a013af192497bb77'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.245089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150d1469acb54f33a013af192497bb77'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.262354 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1109/2236] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:29 2022] DELETE /identity/v3/users/150d1469acb54f33a013af192497bb77 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:29.266841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:29.267331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:29.267429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:29.286150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:29.287369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:29.346018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1128/2237] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:29.356156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:29.357601 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:29.372170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:29.416987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731eeab-f5bf-4105-8fae-768700f1efa7 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:29.420628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:29.421231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:29.421507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:29.421773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:29.430665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:29.432121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:29.441334 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1110/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:29.714474 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:29.716041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:29.745738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd619c-1ad9-4781-897e-2395f264d998 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:29.750918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:29.751621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:29.751921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:29.752218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] PATH_INFO: `/v3/projects/f49a46029372401d8aefdb70c4402809` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:29.753344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49a46029372401d8aefdb70c4402809)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:29.755826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:29.804742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49a46029372401d8aefdb70c4402809', 'request_id': 'req-baf463fe-fa23-4c47-85c3-89294c1b799b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.812748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49a46029372401d8aefdb70c4402809', 'request_id': 'req-baf463fe-fa23-4c47-85c3-89294c1b799b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.819730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49a46029372401d8aefdb70c4402809', 'request_id': 'req-baf463fe-fa23-4c47-85c3-89294c1b799b'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.830359 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] The token cache is being invalidate because project f49a46029372401d8aefdb70c4402809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:29.830644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.831304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.833559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1129/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:29 2022] DELETE /identity/v3/projects/f49a46029372401d8aefdb70c4402809 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:29.837463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:29.846821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605e4c-e40b-480c-a3e0-e292c496fa63 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:29.906598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:29.907228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:29.907563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:29.907833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] PATH_INFO: `/v3/users/83198d13580142038171ade44d986c0b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:29.908985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83198d13580142038171ade44d986c0b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:29.911679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:29.956032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83198d13580142038171ade44d986c0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.956666 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83198d13580142038171ade44d986c0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.964146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83198d13580142038171ade44d986c0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.964763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83198d13580142038171ade44d986c0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.971586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6dea191e-8987-47b7-bd95-f100191a6572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83198d13580142038171ade44d986c0b'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:29.989189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1111/2240] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:29 2022] DELETE /identity/v3/users/83198d13580142038171ade44d986c0b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:30.259428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.260963 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:30.273875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf463fe-fa23-4c47-85c3-89294c1b799b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.294750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:30.334823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.335478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.335759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.336026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] PATH_INFO: `/v3/projects/fc11b24f95604a618c8dc170b2aca3c1` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.337133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc11b24f95604a618c8dc170b2aca3c1)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.339077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.384317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc11b24f95604a618c8dc170b2aca3c1', 'request_id': 'req-8559593b-b1be-4718-a909-48c7f797a1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:30.391437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc11b24f95604a618c8dc170b2aca3c1', 'request_id': 'req-8559593b-b1be-4718-a909-48c7f797a1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:30.397723 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc11b24f95604a618c8dc170b2aca3c1', 'request_id': 'req-8559593b-b1be-4718-a909-48c7f797a1e6'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:30.407767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] The token cache is being invalidate because project fc11b24f95604a618c8dc170b2aca3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:30.408051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:30.408691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8559593b-b1be-4718-a909-48c7f797a1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:30.410180 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1130/2241] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:30 2022] DELETE /identity/v3/projects/fc11b24f95604a618c8dc170b2aca3c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:30.415801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.416277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.416396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.436387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:30.437577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:30.468138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:30.499345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1112/2242] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:30.508001 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.508283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.508555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.527619 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:30.528800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:30.536977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1131/2243] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:30.541127 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.550695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88378b-8764-4209-9b54-5fb13caf6552 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.555840 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.556433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.556713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.556983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.557621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:30.557921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.559537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.571091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1113/2244] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 18:01:30.575111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.584405 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6d839-7e31-46bc-b184-226405423bb4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.589137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.589661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.589935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.590202 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.590820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.592846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.619948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1132/2245] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:30 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:30.624047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.634060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252f054-0c71-40a8-acfb-b7cb003cfb91 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.691483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.692267 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.692534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.692802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.693446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.695381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.716729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1114/2246] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:30 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:01:30.720847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.731838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445cb01-a074-46d4-888f-ba2b5bcecbe4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.736559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.737204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.737523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.737819 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.738604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.740309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.750026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1133/2247] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:30.753718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.764142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112131-6d9e-42bd-bcc7-927487d5edee admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.768692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.769275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.769555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.770595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.771439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.773079 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77535-a48c-4c90-90d1-d87a85428531 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.783614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1115/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:30.787919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.797741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172ba9c-252f-4a50-85eb-bb7cefb7d9d9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:30.802387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:30.803018 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.803327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.803600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] PATH_INFO: `/v3/projects/2188158894674659942eac6296430646/users/13aaa42016664ba599d24be35e9c0207/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.818638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2188158894674659942eac6296430646, user_id=13aaa42016664ba599d24be35e9c0207, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:30.821335 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:30.834897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1134/2249] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:30 2022] PUT /identity/v3/projects/2188158894674659942eac6296430646/users/13aaa42016664ba599d24be35e9c0207/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:30.845242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:30.845463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:30.845729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:30.872923 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] MFA Rules not processed for user `13aaa42016664ba599d24be35e9c0207`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:30.874100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:30.940574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1116/2250] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:01:30.976292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:30.978123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.036939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98c012-8443-45f9-96d7-fdbeaf7da9a1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.040617 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.041217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.041482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.041753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.047048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:31.052925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.054768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8d2bc-3ae5-42ad-9609-509d37db4dc9 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.064505 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1135/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:31.080789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:31.112905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:31.144259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9460-e4b4-4e55-a3ad-61fffa707818 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.150099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.150719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.150993 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.151259 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] PATH_INFO: `/v3/users/13aaa42016664ba599d24be35e9c0207` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.152391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13aaa42016664ba599d24be35e9c0207)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.154292 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.201810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13aaa42016664ba599d24be35e9c0207'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.202448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13aaa42016664ba599d24be35e9c0207'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.209573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13aaa42016664ba599d24be35e9c0207'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.210188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13aaa42016664ba599d24be35e9c0207'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.217281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13aaa42016664ba599d24be35e9c0207'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.234599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1117/2252] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:31 2022] DELETE /identity/v3/users/13aaa42016664ba599d24be35e9c0207 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:31.240063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.240373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.240644 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.260248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:31.261435 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.320098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1136/2253] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:31.330191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:31.331600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.395114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625766-249e-446c-9b22-2f1802f7c593 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.398693 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.399324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.399608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.399873 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.408798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.410228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710401-b4a6-4a9c-a9ab-02b97dfb3629 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.420122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1118/2254] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:31.685039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:31.686616 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.702206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675021-af88-4203-8a46-a833f8af29cd None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.708336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.708968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.709306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.709498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] PATH_INFO: `/v3/projects/2188158894674659942eac6296430646` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.710743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2188158894674659942eac6296430646)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.712676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.759119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2188158894674659942eac6296430646', 'request_id': 'req-26c40c17-fd24-4763-baac-4087b103638c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.766233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2188158894674659942eac6296430646', 'request_id': 'req-26c40c17-fd24-4763-baac-4087b103638c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.773070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2188158894674659942eac6296430646', 'request_id': 'req-26c40c17-fd24-4763-baac-4087b103638c'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.783247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] The token cache is being invalidate because project 2188158894674659942eac6296430646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:31.783559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.784186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-26c40c17-fd24-4763-baac-4087b103638c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:31.786242 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1137/2255] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:31 2022] DELETE /identity/v3/projects/2188158894674659942eac6296430646 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:31.791810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.792094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.792363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.811578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:31.812758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.860438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:31.873539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1119/2256] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:31.882690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.882973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.883244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.903097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:31.904324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:31.912812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1138/2257] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:31.917015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:31.926882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211c6b6-e866-43d2-bb75-aea06e1013a5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.931497 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.932034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.932309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.932578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.933211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:31.933510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.935082 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.946654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1120/2258] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:01:31.950816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:31.960562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d1ed1-7927-4c4a-aec6-e8878f5565db None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:31.965106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:31.965689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:31.965961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:31.966225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:31.966846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:31.968767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:31.995972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1139/2259] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:31 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:32.000182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:32.010246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b762-6682-4017-81ba-e969bba556cb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:32.066098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:32.067217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.067634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.067900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.068529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:32.070449 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:32.096450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1121/2260] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:31 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:01:32.097650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:32.108313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e1ae3-2171-495e-9c43-8c1e0dcc7a53 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:32.113218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:32.113813 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.114136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.114408 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.115059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:32.116721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:32.129633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1140/2261] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:32.132502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:32.142602 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58ca9-a2e4-45e9-9818-874a7c67248c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:32.148287 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:32.148884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.149158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.149425 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.150065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:32.151696 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72cf7-6311-4c65-ac31-398cd3becd8e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:32.163037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1122/2262] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:32.167050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:32.177516 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb05dc-ced7-4b29-9c79-507c02340327 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:32.182314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:32.182907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.183182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.183489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] PATH_INFO: `/v3/projects/ad1f67e06d7b4875934deb82d70e0cc8/users/308971245c124a878a23bf41cda5f028/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.199801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1f67e06d7b4875934deb82d70e0cc8, user_id=308971245c124a878a23bf41cda5f028, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:32.202759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:32.217022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1141/2263] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:32 2022] PUT /identity/v3/projects/ad1f67e06d7b4875934deb82d70e0cc8/users/308971245c124a878a23bf41cda5f028/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:32.227550 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.227835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.228106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.256398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] MFA Rules not processed for user `308971245c124a878a23bf41cda5f028`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:32.257626 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:32.321617 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1123/2264] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:32.333087 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:32.334925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:32.349689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:32.394869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1402-baf4-4a62-a8f6-ab5b0156f5ef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:32.398797 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:32.399429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:32.399711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:32.399983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:32.408369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:32.409781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a17b4-695a-4067-9fba-0f18d5663990 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:32.418973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1142/2265] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:42.318646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:42.414976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=20 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:42.701239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:42.765885 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fb7-4ece-4af8-8e5e-a9c019f21bcb None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:42.770483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:42.771114 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:42.771426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:42.771700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] PATH_INFO: `/v3/users/308971245c124a878a23bf41cda5f028` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:42.772816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=308971245c124a878a23bf41cda5f028)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:42.774733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:42.820017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308971245c124a878a23bf41cda5f028'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:42.820656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308971245c124a878a23bf41cda5f028'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:42.827481 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308971245c124a878a23bf41cda5f028'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:42.828092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308971245c124a878a23bf41cda5f028'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:42.835575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308971245c124a878a23bf41cda5f028'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:42.853051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1124/2266] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:42 2022] DELETE /identity/v3/users/308971245c124a878a23bf41cda5f028 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:42.857668 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:42.857950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:42.858219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:42.877471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:42.878725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:42.938133 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1143/2267] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:42.947619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:42.949063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.012371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e01ec-a0de-434f-96bd-12665a70b95f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.015996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.016595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.016867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.017133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.026764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.028211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3a83-16df-4dcf-b239-6f9fdc17b503 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.037562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1125/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:43.324444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.326170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.339455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4773c-c72b-469d-9f5e-70e977bd2a7b None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.345222 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.346017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.346361 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.346640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] PATH_INFO: `/v3/projects/ad1f67e06d7b4875934deb82d70e0cc8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.348652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1f67e06d7b4875934deb82d70e0cc8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.350651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.400901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1f67e06d7b4875934deb82d70e0cc8', 'request_id': 'req-e1c6ad38-6cd7-449c-875c-16af4c245e8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:43.407632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1f67e06d7b4875934deb82d70e0cc8', 'request_id': 'req-e1c6ad38-6cd7-449c-875c-16af4c245e8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:43.414638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1f67e06d7b4875934deb82d70e0cc8', 'request_id': 'req-e1c6ad38-6cd7-449c-875c-16af4c245e8a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:43.424948 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] The token cache is being invalidate because project ad1f67e06d7b4875934deb82d70e0cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:43.426078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:43.426477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e1c6ad38-6cd7-449c-875c-16af4c245e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:43.428004 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1144/2269] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:43 2022] DELETE /identity/v3/projects/ad1f67e06d7b4875934deb82d70e0cc8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:43.432943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.433376 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.433498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.453542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:43.454667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.471753 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:43.516852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1126/2270] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:43.524919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.525199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.525493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.545011 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:43.546184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.554485 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1145/2271] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:43.558568 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.568246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd487-674a-4aa7-9954-3104450b5146 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.572738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.573319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.573592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.573858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.574486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:43.574783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.576424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.588255 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1127/2272] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:01:43.592159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.601829 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957a79-4dae-4362-9fcb-43212cd95ffa None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.606409 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.606989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.607261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.607558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.608185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.610046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.638483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1146/2273] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:43.642536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.653863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7410-e1de-4ed2-a797-f3a7ee454d45 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.712106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.712646 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.712921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.713188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.713820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.715779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.736858 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1128/2274] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:43 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:43.740899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.750858 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4a6c-d93e-462f-9801-00da9ac6e7ff admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.755422 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.756005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.756281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.756550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.757184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.758745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.768364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1147/2275] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:43.772815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.782347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750980c7-80dc-46de-ba4a-562e5fc9ac18 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.787461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.788039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.788313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.788580 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.789234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.790809 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f21a-9a44-47b9-af3f-cc890172bba3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.800448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1129/2276] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:43.804327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.813996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93af2b-bb4f-4fc3-a1e5-0248b0f5b8bb admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:43.818546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:43.819171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.819475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.819741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] PATH_INFO: `/v3/projects/2c516c53c42d435b8e334d726ea42147/users/8c0fecd5e9a34a8eacf8bafe5b16ca48/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.834613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c516c53c42d435b8e334d726ea42147, user_id=8c0fecd5e9a34a8eacf8bafe5b16ca48, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:43.837254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:43.849774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1148/2277] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:43 2022] PUT /identity/v3/projects/2c516c53c42d435b8e334d726ea42147/users/8c0fecd5e9a34a8eacf8bafe5b16ca48/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:43.854738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa192-2665-46b9-b7de-3b29c51da124 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:43.855017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa192-2665-46b9-b7de-3b29c51da124 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:43.855303 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa192-2665-46b9-b7de-3b29c51da124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:43.875305 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-81efa192-2665-46b9-b7de-3b29c51da124 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:43.876483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-81efa192-2665-46b9-b7de-3b29c51da124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.933145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1130/2278] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:43.943434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:43.945098 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:43.968204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:44.005483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28839-22dd-44b1-9dd4-4ded31b0cef2 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:44.014341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:44.014954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:44.015226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:44.015523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:44.024989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:44.026392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:44.035570 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1149/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:48.863020 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:48.863702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:48.863702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:48.898251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] MFA Rules not processed for user `8c0fecd5e9a34a8eacf8bafe5b16ca48`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:48.899561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:48.918814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:48.973323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1131/2280] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:48.977899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:48.988630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa250b3-46b6-4c44-8b19-bde6427211a3 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:48.993694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:48.994333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:48.994613 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:48.994887 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:48.995555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:48.997477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.026367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1150/2281] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:48 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:49.030397 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:49.042370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344f925-b2e3-4c23-b93e-006c68d435ee None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:49.101220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:49.101842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:49.102122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:49.102392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:49.103077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:49.105091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.131090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1132/2282] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:49 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:49.132295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:49.143093 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ed6c-67d0-4a6c-990b-2fb2a46f3790 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:49.148788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:49.149394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:49.150061 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:49.151025 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:49.151877 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:49.153947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.166622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1151/2283] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:01:49.170439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:49.181101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee73f4e-c216-486c-8ed1-29bec5f1db6d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:49.186095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:49.186757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:49.187096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:49.187302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] PATH_INFO: `/v3/projects/a02b86e034164fb48da84789ad3cca9c/users/29009d4768594beba155470ed7f67261/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:49.211049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02b86e034164fb48da84789ad3cca9c, user_id=29009d4768594beba155470ed7f67261, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:49.213926 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.233464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1133/2284] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:49 2022] PUT /identity/v3/projects/a02b86e034164fb48da84789ad3cca9c/users/29009d4768594beba155470ed7f67261/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:49.234635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:49.246452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40208652-62d2-41e0-815f-b1a37e44e425 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:49.314105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:49.314954 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:49.315430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:49.316381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:49.317396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:49.318999 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.331371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1152/2285] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:49.336026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:49.347301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6636-50c9-490c-ad3a-c9575db890fc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:49.353282 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:49.353966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:49.354251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:49.354522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] PATH_INFO: `/v3/projects/a02b86e034164fb48da84789ad3cca9c/users/29009d4768594beba155470ed7f67261/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:49.356537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02b86e034164fb48da84789ad3cca9c, user_id=29009d4768594beba155470ed7f67261, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:49.359205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5f090-d07f-4776-929f-5bd14eab66b2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:49.372871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1134/2286] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:49 2022] PUT /identity/v3/projects/a02b86e034164fb48da84789ad3cca9c/users/29009d4768594beba155470ed7f67261/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:50.484438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:50.552412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98038a-b5e7-490a-a5c8-2f5f1f7225c7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:50.602355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:50.613281 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:50.614249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:50.615933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:50.616757 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:50.618958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:50.710190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:50.711774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:50.723476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1153/2287] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:54.677249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:54.677747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:54.677747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:54.732036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] MFA Rules not processed for user `29009d4768594beba155470ed7f67261`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:54.733281 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:54.820708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:54.835415 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1135/2288] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:54.850045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:54.851532 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:54.946368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727dfda-9637-44be-9c68-c10e0f260eb6 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:54.952736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:54.953484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:54.953868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:54.954243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:55.040287 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:55.042305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:55.076129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1154/2289] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:55.381945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:55.383611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:55.504567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:55.506468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:55.552774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de1ff3-7394-431f-b717-21320c6d4ed4 service nova] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:55.558440 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:55.559744 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:55.560378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:55.560992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] PATH_INFO: `/v3/users/57705b9fa1544050b59d5bf298d66931` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:55.562612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57705b9fa1544050b59d5bf298d66931)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:55.568354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:55.615381 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed3d75-da9a-40ed-ad06-55b73ddd821c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:55.630110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:55.633580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:55.634824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:55.637143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:55.638406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:55.645966 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:55.683810 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:55.686656 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:55.688402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57705b9fa1544050b59d5bf298d66931'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:55.693397 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57705b9fa1544050b59d5bf298d66931'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:55.713218 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57705b9fa1544050b59d5bf298d66931'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:55.714770 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57705b9fa1544050b59d5bf298d66931'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:55.727065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1136/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:55.732280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-9ea70c68-3efc-4050-b5df-0dc49fd28579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57705b9fa1544050b59d5bf298d66931'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:55.773746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1155/2291] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:55 2022] DELETE /identity/v3/users/57705b9fa1544050b59d5bf298d66931 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:56.076780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.104053 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455218a-7c19-4323-87ae-4e0a6b1a451f service placement] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.194927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.197021 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.197472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.198032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] PATH_INFO: `/v3/projects/4c20b6a9ec5042878702085c1e42dbdd` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.199710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20b6a9ec5042878702085c1e42dbdd)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.202034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.269275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20b6a9ec5042878702085c1e42dbdd', 'request_id': 'req-f43f2130-df1a-44dc-ba99-55aae550d76c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:56.276582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20b6a9ec5042878702085c1e42dbdd', 'request_id': 'req-f43f2130-df1a-44dc-ba99-55aae550d76c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:56.287489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20b6a9ec5042878702085c1e42dbdd', 'request_id': 'req-f43f2130-df1a-44dc-ba99-55aae550d76c'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:56.301231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] The token cache is being invalidate because project 4c20b6a9ec5042878702085c1e42dbdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:01:56.301877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:56.302792 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f43f2130-df1a-44dc-ba99-55aae550d76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:01:56.304909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1137/2292] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:01:56 2022] DELETE /identity/v3/projects/4c20b6a9ec5042878702085c1e42dbdd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:01:56.309671 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.310158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.310279 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.335515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:56.337056 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:56.425375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1156/2293] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:56.433487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.433770 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.434076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.457393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:56.458587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:56.475737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1138/2294] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:56.480295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.493152 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd3cd6-dce7-415f-b968-3fc5fddec70f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.500040 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.500763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.501095 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.501882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.502726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:01:56.503207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.505146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.534225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1157/2295] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 18:01:56.538150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.551888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc294b-b66b-4017-9ee7-f61850dddc4d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.557128 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.559379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.559538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.559871 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.560565 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.562729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d935c-1aba-406a-a69e-01415e61dbbd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.569135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:56.603615 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1139/2296] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:56.607083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.627254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8517c-32e4-43c4-8d3d-70e0fb34e48c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.722398 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.723049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.723049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.730122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.731003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.731479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.731795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.732429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.734547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.746346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] MFA Rules not processed for user `8c0fecd5e9a34a8eacf8bafe5b16ca48`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:56.747814 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:56.757994 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1158/2297] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:01:56.761844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.774995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb48ff8-41fe-4192-9d0f-9a56f8cdcbee admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.780610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.781284 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.781626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.781960 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.782672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.785302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.808174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1159/2298] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:01:56.809230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.815322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1140/2299] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:56.824206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947822-b151-4fab-8da9-caade8ee50e3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.829427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.830471 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.831752 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.832032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.833213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.834567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b9318-521f-488c-9104-9727f53fb33c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.836033 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:01:56.851313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1160/2300] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:01:56.852849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:56.864311 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06559f-8e3c-4248-ac50-32aa58782901 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:56.869372 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:56.872490 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.872762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.873031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] PATH_INFO: `/v3/projects/cdfaa5417aa547d09f240f686cdbab1a/users/6474dbf7105c420ebcce3f2954744fb4/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.891959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfaa5417aa547d09f240f686cdbab1a, user_id=6474dbf7105c420ebcce3f2954744fb4, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:56.896171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:56.921450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1141/2301] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:01:56 2022] PUT /identity/v3/projects/cdfaa5417aa547d09f240f686cdbab1a/users/6474dbf7105c420ebcce3f2954744fb4/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:01:56.922758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:56.923774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:56.923774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:56.954017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] MFA Rules not processed for user `6474dbf7105c420ebcce3f2954744fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:01:56.955715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:57.030135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1161/2302] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:01:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:01:57.043776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:01:57.045812 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:01:57.141826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f1eff-7be2-4287-a2e3-5835d414e528 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:01:57.154044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:01:57.154766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:01:57.155112 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:01:57.155474 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:01:57.168546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:01:57.170271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337796f-1a19-4003-9103-381fcf5712c9 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:01:57.181239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1142/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:01:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:01:59.965766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.029724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca65e-3a87-4b8c-aec5-31832dd66d69 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:00.034886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:00.035581 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.035861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.036130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] PATH_INFO: `/v3/users/6474dbf7105c420ebcce3f2954744fb4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.037265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6474dbf7105c420ebcce3f2954744fb4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:00.039178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:00.085313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6474dbf7105c420ebcce3f2954744fb4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.085952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6474dbf7105c420ebcce3f2954744fb4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.092710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6474dbf7105c420ebcce3f2954744fb4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.093328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6474dbf7105c420ebcce3f2954744fb4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.103481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6474dbf7105c420ebcce3f2954744fb4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.121641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1162/2304] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:01:59 2022] DELETE /identity/v3/users/6474dbf7105c420ebcce3f2954744fb4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:00.126095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.126598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.126788 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.145729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:00.146917 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:00.196078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:00.210475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1143/2305] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:00.220900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.222401 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:00.228956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:00.283974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba33aba-4163-4a3d-a70e-2023faedfbd9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:00.288380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:00.288980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.289251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.289520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.299036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:00.300650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8500b74-c122-4acc-99c6-ebaf5b298326 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:00.311129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1163/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:00.605045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.606593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:00.623520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047c764-5b7f-4520-9ff0-e37c4a469cb9 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:00.629850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:00.630505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.630816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.631051 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] PATH_INFO: `/v3/projects/cdfaa5417aa547d09f240f686cdbab1a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.632271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfaa5417aa547d09f240f686cdbab1a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:00.634440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:00.682447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfaa5417aa547d09f240f686cdbab1a', 'request_id': 'req-c5ba2d51-1140-4938-b76c-3ad62b240664'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.689003 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfaa5417aa547d09f240f686cdbab1a', 'request_id': 'req-c5ba2d51-1140-4938-b76c-3ad62b240664'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.698218 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfaa5417aa547d09f240f686cdbab1a', 'request_id': 'req-c5ba2d51-1140-4938-b76c-3ad62b240664'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.710137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] The token cache is being invalidate because project cdfaa5417aa547d09f240f686cdbab1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:00.710423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.711064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c5ba2d51-1140-4938-b76c-3ad62b240664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:00.712658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1144/2307] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:00 2022] DELETE /identity/v3/projects/cdfaa5417aa547d09f240f686cdbab1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:00.717508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.717796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.718071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.739358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:00.740665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:00.803191 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1164/2308] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:00.816467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.816768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.817045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.838427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:00.839645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:00.848525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1145/2309] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:02:00.852777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.862388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f60a9-3051-4917-8456-70e8d68ac56e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:00.868377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:00.869364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.869645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.869914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.870751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:02:00.871053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:00.873136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:00.885932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1165/2310] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:02:00.890273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.899444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d672eb-1df8-4ddc-94df-cbdb2d8e803c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:00.904036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:00.904623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:00.904895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:00.905162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:00.905779 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:00.907783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:00.935085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1146/2311] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:00 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:02:00.939363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:00.950959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60a60-05ee-427e-b790-ebd59db34309 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.008977 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.009634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.009761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.010027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.010651 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.012595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.037640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1166/2312] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:00 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:01.041765 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.053001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b411d-4f96-4690-8f3f-8e6ecfe68c13 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.057663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.058254 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.058529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.058798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.059471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.061066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.071668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1147/2313] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:01.075432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.085624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec2054-744e-4e31-9af4-af093ddf8c60 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.090536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.091182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.091492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.091841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.092539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.094283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1555b53-08d0-4c45-80a9-518a1afa8b12 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.106419 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1167/2314] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:01.110629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.121235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e341835-7fc7-4fc6-ba67-e5d6034dcdfc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.125831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.126462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.127025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.127025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] PATH_INFO: `/v3/projects/858c6053a4414d4ea7b39e94b7ffe155/users/d13285d84d194ae581eb7dccab4466ea/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.142384 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858c6053a4414d4ea7b39e94b7ffe155, user_id=d13285d84d194ae581eb7dccab4466ea, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.145360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.159239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1148/2315] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:01 2022] PUT /identity/v3/projects/858c6053a4414d4ea7b39e94b7ffe155/users/d13285d84d194ae581eb7dccab4466ea/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:02:01.169808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.170090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.170356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.199549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:01.202897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] MFA Rules not processed for user `d13285d84d194ae581eb7dccab4466ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:01.205045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:01.273601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1168/2316] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:01.278095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.341245 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694849a9-6a16-4daa-8018-88cca4858b02 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.345899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.346500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.346778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.347049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.348304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.350212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.374645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:01.387169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1149/2317] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:01 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:01.388420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.399942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89cef1-27ae-4975-b132-b6bfbea12d69 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.468240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.468849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.469129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.469417 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.470072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.472053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.498747 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1169/2318] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:01 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:01.500031 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.525166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1621b-42fd-4606-b551-aa388179d00f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.529884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.530498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.530803 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.531070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.531745 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.533574 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.548066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1150/2319] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:01.551932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.570869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedc432-5fd0-48b0-adf5-5346e9fa029e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.575595 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.576255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.576528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.576796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] PATH_INFO: `/v3/projects/9c623193b5874c5eabf17e427feec070/users/dee64e7c134942b2b4cd1f4681f1856f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.592548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c623193b5874c5eabf17e427feec070, user_id=dee64e7c134942b2b4cd1f4681f1856f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.595173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.608240 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1170/2320] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:01 2022] PUT /identity/v3/projects/9c623193b5874c5eabf17e427feec070/users/dee64e7c134942b2b4cd1f4681f1856f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:01.612196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.623115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca1794-3c98-464b-92e6-d21c199d784a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.681142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.681673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.681957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.682228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.682891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.684537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90710542-8c1c-496a-bef6-cd59a8a027b6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.696077 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1151/2321] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:01.700120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.711306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e7ff-b004-461e-b1d6-5171ed9243ae admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.715826 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.716461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.716736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.716996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] PATH_INFO: `/v3/projects/9c623193b5874c5eabf17e427feec070/users/dee64e7c134942b2b4cd1f4681f1856f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.718857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c623193b5874c5eabf17e427feec070, user_id=dee64e7c134942b2b4cd1f4681f1856f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.721500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.731546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1171/2322] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:01 2022] PUT /identity/v3/projects/9c623193b5874c5eabf17e427feec070/users/dee64e7c134942b2b4cd1f4681f1856f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:01.744903 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.745188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.745453 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.773130 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] MFA Rules not processed for user `dee64e7c134942b2b4cd1f4681f1856f`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:01.774320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:01.843064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1152/2323] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:01.854385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:01.856132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:01.916294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3081a9-4370-4e15-9154-8dd24d455092 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:01.919846 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:01.920442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:01.920716 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:01.920989 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:01.929864 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:01.931299 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:01.935270 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:01.941390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1172/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:02.017844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:02.028181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b017e08-4288-4f5d-9439-56efed22b406 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:02.031735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:02.032426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:02.032709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:02.032976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:02.095747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:02.099318 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a80c47-467b-4bbb-903b-decd663f751f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:02.117134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1153/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:11.947721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:12.113519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:17.080332 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:17.142264 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c306-608c-4ae4-9e09-c21f727373dd service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:17.147412 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:17.148024 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:17.148295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:17.148559 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] PATH_INFO: `/v3/users/d13285d84d194ae581eb7dccab4466ea` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:17.149652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13285d84d194ae581eb7dccab4466ea)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:17.151576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:17.197327 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13285d84d194ae581eb7dccab4466ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.198012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13285d84d194ae581eb7dccab4466ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.205228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13285d84d194ae581eb7dccab4466ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.205859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13285d84d194ae581eb7dccab4466ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.213673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13285d84d194ae581eb7dccab4466ea'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.231763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1173/2326] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:17 2022] DELETE /identity/v3/users/d13285d84d194ae581eb7dccab4466ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:17.236225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:17.236682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:17.236844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:17.256353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:17.257532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:17.315315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1154/2327] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:17.325446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:17.326841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:17.385080 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe71a-e3b7-49dd-8af5-feb580857262 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:17.388753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:17.389352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:17.389629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:17.389902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:17.399261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:17.400695 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:17.410660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1174/2328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:17.683321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:17.683321 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:17.696850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1445b-df8f-49fb-9a37-9bf16d8712f7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:17.701469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:17.702090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:17.702363 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:17.702630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] PATH_INFO: `/v3/projects/858c6053a4414d4ea7b39e94b7ffe155` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:17.703764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=858c6053a4414d4ea7b39e94b7ffe155)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:17.705967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:17.754432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858c6053a4414d4ea7b39e94b7ffe155', 'request_id': 'req-ed9ce343-88ef-4670-9b36-c98170be27ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.760823 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858c6053a4414d4ea7b39e94b7ffe155', 'request_id': 'req-ed9ce343-88ef-4670-9b36-c98170be27ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.769586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858c6053a4414d4ea7b39e94b7ffe155', 'request_id': 'req-ed9ce343-88ef-4670-9b36-c98170be27ce'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.780280 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] The token cache is being invalidate because project 858c6053a4414d4ea7b39e94b7ffe155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:17.780642 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.781340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.782895 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1155/2329] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:17 2022] DELETE /identity/v3/projects/858c6053a4414d4ea7b39e94b7ffe155 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:17.787464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:17.796931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21212998-848f-4180-8db7-7f55cbfdc7be service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:17.815053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:17.858599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:17.859231 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:17.859533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:17.859816 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] PATH_INFO: `/v3/users/dee64e7c134942b2b4cd1f4681f1856f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:17.860926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee64e7c134942b2b4cd1f4681f1856f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:17.862901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:17.909907 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee64e7c134942b2b4cd1f4681f1856f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.910607 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee64e7c134942b2b4cd1f4681f1856f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.917383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee64e7c134942b2b4cd1f4681f1856f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.918000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee64e7c134942b2b4cd1f4681f1856f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.925771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62a963e-d61a-4a81-87e2-5791106086a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee64e7c134942b2b4cd1f4681f1856f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:17.942980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1175/2330] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:17 2022] DELETE /identity/v3/users/dee64e7c134942b2b4cd1f4681f1856f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:02:18.214857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.216326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:18.229769 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ce343-88ef-4670-9b36-c98170be27ce admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.288367 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.289025 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.289260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.289529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] PATH_INFO: `/v3/projects/9c623193b5874c5eabf17e427feec070` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.290655 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c623193b5874c5eabf17e427feec070)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.292603 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.325676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:18.346110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c623193b5874c5eabf17e427feec070', 'request_id': 'req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:18.353800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c623193b5874c5eabf17e427feec070', 'request_id': 'req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:18.361048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c623193b5874c5eabf17e427feec070', 'request_id': 'req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:18.372715 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] The token cache is being invalidate because project 9c623193b5874c5eabf17e427feec070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:18.373000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:18.373632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6411fdcb-ff99-4a5e-b34d-cbba9b93fdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:18.375139 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1156/2331] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:18 2022] DELETE /identity/v3/projects/9c623193b5874c5eabf17e427feec070 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:18.380137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.380634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.380817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.403686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:18.405239 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:18.473367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1176/2332] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:18.481795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.482118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.482424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.504394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:18.505608 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:18.514534 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1157/2333] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:18.519344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.529685 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271581-6913-4de0-b906-18160c12cc13 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.534200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.535615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.535998 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.536277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.536986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:02:18.537276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.538900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.555438 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1177/2334] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:02:18.555928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.565483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d2927-f4a6-40bd-83ee-eb720a165b00 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.571144 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.571790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.572107 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.572278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.572906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.574842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.604244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1158/2335] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:18.608592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.618839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476751a1-b342-4ae0-b2fc-e4d43be56f1a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.648763 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:18.684052 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.684933 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.685213 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.685486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.686128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.688119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.713791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1178/2336] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:18.714947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.725375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bbc56-46d4-4785-a11c-c3fab848f005 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.730069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.730819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.731100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.731445 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.732048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.733658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.746488 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1159/2337] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:18.747905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.758980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1618b-1259-4b6c-91a5-b22b6c2f9fbf admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.763675 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.764395 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.764738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.765015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.765686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.767268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5b53-d1a3-4e48-807f-f0f449a4b223 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.777853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1179/2338] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:02:18.782054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:18.793097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308b956-0294-4f95-9774-23f4bcec8ced admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:18.798095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:18.798737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.799009 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.799424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] PATH_INFO: `/v3/projects/32b0f2cfb3784adb9c74bb497c43d907/users/6ac078f248d349f7b5463059fb9d7512/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.814015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0f2cfb3784adb9c74bb497c43d907, user_id=6ac078f248d349f7b5463059fb9d7512, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:18.817301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:18.832600 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1160/2339] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:18 2022] PUT /identity/v3/projects/32b0f2cfb3784adb9c74bb497c43d907/users/6ac078f248d349f7b5463059fb9d7512/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:18.843248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:18.843632 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:18.843972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:18.881069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] MFA Rules not processed for user `6ac078f248d349f7b5463059fb9d7512`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:18.882577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:18.955183 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1180/2340] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:18.960551 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.035575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b777e-5237-4432-9332-deaab087230a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.040439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.041056 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.041332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.041597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.042269 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.044240 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.073637 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1161/2341] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:18 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:02:19.077449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.091229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec3c1d-e0fd-4ee6-a41f-4144fb6a5418 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.152294 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.152902 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.153190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.153450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.154107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.156139 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.183556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1181/2342] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:19 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:19.187493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.198981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349e7d3-b4b7-4e6e-844b-cca48155ead0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.203837 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.204433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.204964 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.205231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.205870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.208361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.218933 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1162/2343] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:19.223992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.234722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20666e-c6bf-49fe-ab17-44501d6d107c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.239758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.240432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.240767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.241068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] PATH_INFO: `/v3/projects/6412aeace3594dc8aba62cf39aa52268/users/8e965b3ec4dc41b7b290fbb6cf128861/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.257171 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6412aeace3594dc8aba62cf39aa52268, user_id=8e965b3ec4dc41b7b290fbb6cf128861, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.260179 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.274594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1182/2344] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:19 2022] PUT /identity/v3/projects/6412aeace3594dc8aba62cf39aa52268/users/8e965b3ec4dc41b7b290fbb6cf128861/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:19.278855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.289421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea20fc-6650-4284-b40c-b69a8143f6ec admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.309134 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:19.347801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.348403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.348783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.349081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.349709 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.351304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f0f57-8d41-4328-b5de-7e7741cd0c8c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.360884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1163/2345] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:19.365233 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.371147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:19.378523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffdc83-5d94-4bb8-83a0-22689486e35e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.383592 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.384198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.384461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.384727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] PATH_INFO: `/v3/projects/6412aeace3594dc8aba62cf39aa52268/users/8e965b3ec4dc41b7b290fbb6cf128861/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.386661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6412aeace3594dc8aba62cf39aa52268, user_id=8e965b3ec4dc41b7b290fbb6cf128861, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.389312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.400002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1183/2346] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:19 2022] PUT /identity/v3/projects/6412aeace3594dc8aba62cf39aa52268/users/8e965b3ec4dc41b7b290fbb6cf128861/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:19.410978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.411265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.411567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.438629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] MFA Rules not processed for user `8e965b3ec4dc41b7b290fbb6cf128861`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:19.439859 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:19.510456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1164/2347] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:19.522765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.528376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:19.587895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbd32f-d013-43c4-af76-4ccbfb3310f0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.591629 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.592229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.592501 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.592768 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.608167 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.609736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.620355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1184/2348] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 18:02:19.698444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:19.709502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb20b0-d6a7-4d1b-a238-ab837f900b4d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:19.713264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:19.713862 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:19.714137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:19.714406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:19.774242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:19.775713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:19.785278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1165/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:22.840988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:22.842600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:22.911053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fe63-507f-40bc-aa8f-5bd24e0c15bb service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:22.915092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:22.915765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:22.916777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:22.916777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:22.919195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:22.994079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:22.995539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:23.005917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1185/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:24.921393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:24.922816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:24.975536 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:25.003042 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ed58-8afc-4c3c-912b-050fe006805b service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:25.008835 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4114e2020f4135bb6220c7e3aedc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:25.009436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:25.010207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:25.010207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:25.011742 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:25.024429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:25.026026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9b43c-4841-414e-94fe-341a0a58fab5 service nova] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:25.037355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1166/2351] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:25.848790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:25.896603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:25.915783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0ec-228b-45b2-9298-cf9945e3d239 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:25.920400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69639865-a288-4463-b779-38702be836d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:25.921032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639865-a288-4463-b779-38702be836d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:25.921387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639865-a288-4463-b779-38702be836d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:25.921564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639865-a288-4463-b779-38702be836d1 admin admin] PATH_INFO: `/v3/users/6ac078f248d349f7b5463059fb9d7512` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:25.922674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69639865-a288-4463-b779-38702be836d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac078f248d349f7b5463059fb9d7512)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:25.924640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69639865-a288-4463-b779-38702be836d1 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:25.979121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac078f248d349f7b5463059fb9d7512'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:25.980014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac078f248d349f7b5463059fb9d7512'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:25.987027 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac078f248d349f7b5463059fb9d7512'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:25.987733 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac078f248d349f7b5463059fb9d7512'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:25.995544 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac078f248d349f7b5463059fb9d7512'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.012726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1186/2352] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:25 2022] DELETE /identity/v3/users/6ac078f248d349f7b5463059fb9d7512 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:26.017143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:26.017597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:26.017718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:26.037097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:26.038288 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:26.100552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1167/2353] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:26.110497 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:26.112268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:26.169046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69639865-a288-4463-b779-38702be836d1 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:26.172678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:26.173269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:26.173542 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:26.173809 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:26.182980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:26.184399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:26.194905 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1187/2354] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 18:02:26.468878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:26.470419 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:26.486110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d915dd-270b-4737-80b0-25013cf51a3b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:26.491968 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:26.492614 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:26.492891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:26.493162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] PATH_INFO: `/v3/projects/32b0f2cfb3784adb9c74bb497c43d907` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:26.494897 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0f2cfb3784adb9c74bb497c43d907)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:26.497212 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:26.551942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0f2cfb3784adb9c74bb497c43d907', 'request_id': 'req-49ad49a8-32ba-4368-a3db-09c0372b2df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.558463 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0f2cfb3784adb9c74bb497c43d907', 'request_id': 'req-49ad49a8-32ba-4368-a3db-09c0372b2df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.566645 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0f2cfb3784adb9c74bb497c43d907', 'request_id': 'req-49ad49a8-32ba-4368-a3db-09c0372b2df1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.577065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] The token cache is being invalidate because project 32b0f2cfb3784adb9c74bb497c43d907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:26.577353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.577976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.579495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1168/2355] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:26 2022] DELETE /identity/v3/projects/32b0f2cfb3784adb9c74bb497c43d907 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:26.583778 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:26.593104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3387-1b86-4178-8412-e39db0f8de6a service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:26.647874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:26.648482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:26.648755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:26.649020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] PATH_INFO: `/v3/users/8e965b3ec4dc41b7b290fbb6cf128861` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:26.650120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e965b3ec4dc41b7b290fbb6cf128861)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:26.652050 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:26.656665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:26.705478 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e965b3ec4dc41b7b290fbb6cf128861'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.706721 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e965b3ec4dc41b7b290fbb6cf128861'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.713690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e965b3ec4dc41b7b290fbb6cf128861'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.714258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e965b3ec4dc41b7b290fbb6cf128861'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.721323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0fd10324-f8c8-462b-ba1a-ec65dfff54b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e965b3ec4dc41b7b290fbb6cf128861'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:26.739603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1188/2356] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:26 2022] DELETE /identity/v3/users/8e965b3ec4dc41b7b290fbb6cf128861 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:27.012659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.014183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:27.028524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad49a8-32ba-4368-a3db-09c0372b2df1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.078291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:27.089728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.090412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.090733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.091030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] PATH_INFO: `/v3/projects/6412aeace3594dc8aba62cf39aa52268` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.092275 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6412aeace3594dc8aba62cf39aa52268)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.094291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.140513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6412aeace3594dc8aba62cf39aa52268', 'request_id': 'req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:27.146857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6412aeace3594dc8aba62cf39aa52268', 'request_id': 'req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:27.154184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6412aeace3594dc8aba62cf39aa52268', 'request_id': 'req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:27.165400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] The token cache is being invalidate because project 6412aeace3594dc8aba62cf39aa52268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:27.165676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:27.166284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-befa2fe1-a06c-4c3b-95b8-e4ea6e895c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:27.167807 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1169/2357] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:27 2022] DELETE /identity/v3/projects/6412aeace3594dc8aba62cf39aa52268 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:02:27.172704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.173155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.173283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.193365 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:27.194562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:27.253432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1189/2358] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:27.261042 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.261328 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.261592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.281499 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:27.282683 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:27.291304 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1170/2359] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:27.295441 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.305090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35c8c-4bd8-4943-9d06-b18d5cc3dcdc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.309600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.310248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.310527 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.310792 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.311489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:02:27.311788 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.313390 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.324926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1190/2360] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:02:27.329257 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.339736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3a71-ab0a-4556-8492-b20d42bcca3b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.344406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.344988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.345265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.345535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.346153 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.349173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.376567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1171/2361] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:27.380720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.390502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528906a2-55f4-4367-b62a-8166320ba29b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.445621 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.446217 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.446496 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.446766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.447427 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.449344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.466727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:27.476338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1191/2362] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:02:27.477764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.490037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719015f-aed4-43e6-b1bc-1b48cf4f9ca9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.494739 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.495383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.495674 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.495947 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.496596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.498394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.509500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1172/2363] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:27.513144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.523538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a84e90-fed9-4b27-87e3-2b6b669be158 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.528382 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.528996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.529312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.529645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.530386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.532186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0418515-cc99-483f-9569-c9d6f123db62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.544701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1192/2364] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:27.548914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.559059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47c5d0-d6f0-4366-8ec3-a04a114596c9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.563677 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.564319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.564597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.564867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] PATH_INFO: `/v3/projects/521e5eca1f0c41d29e5506645e4f8335/users/f238d0dcdc7043d09e4c0a9dbe0e8925/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.580137 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521e5eca1f0c41d29e5506645e4f8335, user_id=f238d0dcdc7043d09e4c0a9dbe0e8925, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.583631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.598443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1173/2365] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:27 2022] PUT /identity/v3/projects/521e5eca1f0c41d29e5506645e4f8335/users/f238d0dcdc7043d09e4c0a9dbe0e8925/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:27.608772 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.609078 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.609380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.638748 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] MFA Rules not processed for user `f238d0dcdc7043d09e4c0a9dbe0e8925`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:27.639974 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:27.713725 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1193/2366] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:27.718362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.781787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b851-2563-4f70-a881-7ab373342341 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.787035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.787662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.787936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.788201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.788811 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.790691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.817406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1174/2367] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:27.821010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.832141 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4607f-141a-40f7-ad5e-3b6f5ccf5cb5 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.888453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.889046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.889318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.889583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.890196 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.892136 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.912987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1194/2368] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:27 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:27.917074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.923648 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:27.928477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27450b4-62e4-4014-a2d6-90e820845fcb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.934202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.935007 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.935309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.935570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.936204 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.937786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.948324 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1175/2369] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:27.952420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:27.963123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9feb1-72db-4162-8185-9493a796e987 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:27.967699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:27.968334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:27.968609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:27.968875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] PATH_INFO: `/v3/projects/14378fce03624aef853e9f57ede5e22b/users/63f502c988814a85b1ad444d2c00eb7f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:27.984166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14378fce03624aef853e9f57ede5e22b, user_id=63f502c988814a85b1ad444d2c00eb7f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:27.986817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:27.999540 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1195/2370] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:27 2022] PUT /identity/v3/projects/14378fce03624aef853e9f57ede5e22b/users/63f502c988814a85b1ad444d2c00eb7f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:28.003322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:28.013189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92414d-bc5a-46fe-b438-092110aa1525 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:28.068426 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:28.069030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:28.069210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:28.069478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:28.070158 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:28.071763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7112bb-313b-40bc-be39-24dfb42f9e22 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:28.082219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1176/2371] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:28.086378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:28.096439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293e55-83bc-4015-a510-88331e15377d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:28.101815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:28.102458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:28.102736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:28.103005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] PATH_INFO: `/v3/projects/14378fce03624aef853e9f57ede5e22b/users/63f502c988814a85b1ad444d2c00eb7f/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:28.104968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14378fce03624aef853e9f57ede5e22b, user_id=63f502c988814a85b1ad444d2c00eb7f, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:28.107811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:28.117928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1196/2372] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:28 2022] PUT /identity/v3/projects/14378fce03624aef853e9f57ede5e22b/users/63f502c988814a85b1ad444d2c00eb7f/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:28.129057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:28.129350 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:28.129610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:28.156909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] MFA Rules not processed for user `63f502c988814a85b1ad444d2c00eb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:28.158120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:28.225190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1177/2373] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:02:28.236041 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:28.238091 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:28.272383 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:28.297101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4517c0-b381-4d63-a5f4-4d418c463b10 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:28.300914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:28.301512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:28.301790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:28.302068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:28.310981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:28.312446 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:28.322425 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1197/2374] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:28.369403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:28.370780 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:28.383480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061e09-8f93-4af1-bd7b-c8e8f6202519 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:28.387057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:28.387678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:28.387953 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:28.388250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:28.448196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:28.449630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc064b7-5822-4ef2-a0b3-c7e901ff4c68 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:28.459502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1178/2375] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:31.752082 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:31.817980 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04987a3-cac1-4a9c-acf8-7fc13cf3691e service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:31.822520 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:31.823149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:31.823464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:31.823738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] PATH_INFO: `/v3/users/f238d0dcdc7043d09e4c0a9dbe0e8925` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:31.824892 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f238d0dcdc7043d09e4c0a9dbe0e8925)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:31.826810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:31.880600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f238d0dcdc7043d09e4c0a9dbe0e8925'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:31.881197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f238d0dcdc7043d09e4c0a9dbe0e8925'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:31.888791 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f238d0dcdc7043d09e4c0a9dbe0e8925'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:31.889576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f238d0dcdc7043d09e4c0a9dbe0e8925'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:31.898755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f238d0dcdc7043d09e4c0a9dbe0e8925'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:31.919130 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1198/2376] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:31 2022] DELETE /identity/v3/users/f238d0dcdc7043d09e4c0a9dbe0e8925 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:31.923671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:31.924208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:31.924208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:31.943058 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:31.944429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:31.953263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:32.006821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1179/2377] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:32.016459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:32.017945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:32.078219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcadd6c-3ae3-4d20-92e0-c7d7a7f12ae0 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:32.082787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:32.083423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:32.083699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:32.083962 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:32.091258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:32.093753 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:32.095760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:32.107305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1199/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:32.406685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:32.408143 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:32.420129 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6df7-2905-4534-802c-fa2bd46b4fe6 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:32.424961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:32.425527 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:32.425819 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:32.426090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] PATH_INFO: `/v3/projects/521e5eca1f0c41d29e5506645e4f8335` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:32.427203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521e5eca1f0c41d29e5506645e4f8335)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:32.431194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:32.480391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521e5eca1f0c41d29e5506645e4f8335', 'request_id': 'req-d2ed3660-297d-44bd-bf54-0130f1643ef0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.487567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521e5eca1f0c41d29e5506645e4f8335', 'request_id': 'req-d2ed3660-297d-44bd-bf54-0130f1643ef0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.494970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521e5eca1f0c41d29e5506645e4f8335', 'request_id': 'req-d2ed3660-297d-44bd-bf54-0130f1643ef0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.506219 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] The token cache is being invalidate because project 521e5eca1f0c41d29e5506645e4f8335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:32.506501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.507119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.508636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1180/2379] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:32 2022] DELETE /identity/v3/projects/521e5eca1f0c41d29e5506645e4f8335 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:32.512582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:32.522103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2eab-6c39-43b2-b9d7-c373e45436b7 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:32.578103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:32.578722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:32.579003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:32.579288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] PATH_INFO: `/v3/users/63f502c988814a85b1ad444d2c00eb7f` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:32.580704 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f502c988814a85b1ad444d2c00eb7f)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:32.582932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:32.628624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f502c988814a85b1ad444d2c00eb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.629331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f502c988814a85b1ad444d2c00eb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.636321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f502c988814a85b1ad444d2c00eb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.636942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f502c988814a85b1ad444d2c00eb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.644170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dce5167d-e233-4a5a-8abc-adbbff71743a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f502c988814a85b1ad444d2c00eb7f'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:32.661123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1200/2380] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:32 2022] DELETE /identity/v3/users/63f502c988814a85b1ad444d2c00eb7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:33.001513 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.003206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:33.016890 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed3660-297d-44bd-bf54-0130f1643ef0 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.079563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.080483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.080784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.081050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] PATH_INFO: `/v3/projects/14378fce03624aef853e9f57ede5e22b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.082195 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14378fce03624aef853e9f57ede5e22b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.084162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.126317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:33.135050 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14378fce03624aef853e9f57ede5e22b', 'request_id': 'req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:33.141955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14378fce03624aef853e9f57ede5e22b', 'request_id': 'req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:33.149805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14378fce03624aef853e9f57ede5e22b', 'request_id': 'req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:33.162174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] The token cache is being invalidate because project 14378fce03624aef853e9f57ede5e22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:33.162461 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:33.163122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-3bb1bb06-d33a-4d7d-b9f9-e797bdc6ef78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:33.164641 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1181/2381] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:33 2022] DELETE /identity/v3/projects/14378fce03624aef853e9f57ede5e22b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:33.169841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.170376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.170376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.191935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:33.193150 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:33.255522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1201/2382] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:33.263470 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.263787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.264091 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.285206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:33.286466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:33.294658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1182/2383] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:33.298938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.308914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f0e1-88de-4f93-8b81-b5d419f33ba3 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.313460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.314048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.314324 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.314594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.315363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:02:33.315751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.317330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.328765 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1202/2384] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:02:33.333891 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.343447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b2ee-34ea-4115-aa97-be540473c6c5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.348945 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.349559 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.349849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.350140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.350787 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.352912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.381171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1183/2385] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:33.385232 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.390420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:33.397151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb12ece-d40f-4a73-b6ac-b0fbbadc5fd8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.452680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.453274 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.453552 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.453822 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.454449 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.457261 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.478246 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1203/2386] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:33.482214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.493876 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33099d82-e240-4b87-8829-54da2069c6f5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.498705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.499330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.499609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.499986 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.500631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.502230 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.512503 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1184/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:33.516302 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.526730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36af75-ffd0-44bb-a309-07c2c99dab05 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.531219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.531831 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.532107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.532375 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.533005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.535156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396a0ad-c2c4-4dd6-a5bd-e71e9dfb5199 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.546426 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1204/2388] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:33.550651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.560582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dec75-8e16-41b7-9305-3abe0e027438 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.565773 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.566420 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.566695 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.566962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] PATH_INFO: `/v3/projects/52098d334abd41c58274471a1384fe3b/users/2a8dcf24eff14420bbe7d62e2e485bc0/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.582454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52098d334abd41c58274471a1384fe3b, user_id=2a8dcf24eff14420bbe7d62e2e485bc0, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.585191 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.597512 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1185/2389] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:33 2022] PUT /identity/v3/projects/52098d334abd41c58274471a1384fe3b/users/2a8dcf24eff14420bbe7d62e2e485bc0/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:33.608901 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.609185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.609475 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.636934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] MFA Rules not processed for user `2a8dcf24eff14420bbe7d62e2e485bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:33.638129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:33.701415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1205/2390] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:33.706981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.766828 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e3c0-8161-46d5-85ee-59512fd6e62d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.772061 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.772653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.772940 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.773211 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.773832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.775775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.801514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1186/2391] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:33.805624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.816676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46384d31-275d-48da-8e55-8cfed3711a55 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.873399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.874003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.874282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.874569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.875186 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.877108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.894896 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:33.902321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1206/2392] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:33 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:33.904262 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.914442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7fdb3-546b-4e27-a0b0-7fea5571dab5 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.919096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.919702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.919977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.920247 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.920878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.922496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.933071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1187/2393] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:33.937111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:33.947597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0652-2370-4430-a3a3-8bb57ee01827 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:33.952259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:33.952893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:33.953173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:33.953445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] PATH_INFO: `/v3/projects/c325291e575c4c889f4b74f7735b82a1/users/c6fc0851d02c4109bfd725d007426042/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:33.970128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c325291e575c4c889f4b74f7735b82a1, user_id=c6fc0851d02c4109bfd725d007426042, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:33.973146 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:33.985609 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1207/2394] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:33 2022] PUT /identity/v3/projects/c325291e575c4c889f4b74f7735b82a1/users/c6fc0851d02c4109bfd725d007426042/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:33.990309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.000084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee2d79-46b7-4972-99e0-f4dfeceab0a6 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:34.032413 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:34.057878 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:34.058482 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.058762 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.059032 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.059704 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:34.061296 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc377-e9b6-4afa-9478-e381d2ebe27b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:34.075777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1188/2395] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:34.076746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.088346 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffa97-ab2d-4f30-acbf-6993fb28446a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:34.093288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:34.093930 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.094205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.094469 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] PATH_INFO: `/v3/projects/c325291e575c4c889f4b74f7735b82a1/users/c6fc0851d02c4109bfd725d007426042/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.096451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c325291e575c4c889f4b74f7735b82a1, user_id=c6fc0851d02c4109bfd725d007426042, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:34.099153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:34.110493 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1208/2396] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:34 2022] PUT /identity/v3/projects/c325291e575c4c889f4b74f7735b82a1/users/c6fc0851d02c4109bfd725d007426042/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:34.121001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.121278 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.121547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.151416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] MFA Rules not processed for user `c6fc0851d02c4109bfd725d007426042`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:34.152889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:34.223793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1189/2397] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:34.235815 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.238132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:34.295206 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732f45b-8c58-4528-8d21-05f1c4941f22 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:34.298697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:34.299972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.300190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.300385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.309131 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:34.310536 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:34.320439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1209/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:34.395294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.405452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc818-5dba-46ea-8187-b2af946e0345 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:34.409929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:34.410582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.410894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.411174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.468863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:34.470284 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cf20-d916-4c6a-b616-09c19955e53f service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:34.479684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1190/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:34.744184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.805263 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d443b-1096-411d-b73a-aa6ed34ea03f service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:34.809640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:34.810260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.810537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.810814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] PATH_INFO: `/v3/users/2a8dcf24eff14420bbe7d62e2e485bc0` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.811947 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8dcf24eff14420bbe7d62e2e485bc0)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:34.813843 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:34.859688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8dcf24eff14420bbe7d62e2e485bc0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:34.860340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8dcf24eff14420bbe7d62e2e485bc0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:34.868109 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8dcf24eff14420bbe7d62e2e485bc0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:34.868736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8dcf24eff14420bbe7d62e2e485bc0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:34.875225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8dcf24eff14420bbe7d62e2e485bc0'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:34.880710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:34.896309 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1210/2400] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:34 2022] DELETE /identity/v3/users/2a8dcf24eff14420bbe7d62e2e485bc0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:34.900852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:34.901133 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:34.901400 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:34.919900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:34.921090 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:34.970455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=100 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:34.979733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1191/2401] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:34.990199 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:34.991599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:35.052641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbee06-209e-48b7-93ac-254c597a0116 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:35.056369 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:35.056910 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:35.057185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:35.057455 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:35.067219 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:35.068700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:35.078022 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1211/2402] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:35.346699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:35.348272 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:35.359989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85948c-3798-4748-9459-e0f8c186f6ec None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:35.365151 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:35.365778 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:35.366095 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:35.366313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] PATH_INFO: `/v3/projects/52098d334abd41c58274471a1384fe3b` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:35.367450 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52098d334abd41c58274471a1384fe3b)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:35.369361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:35.416300 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52098d334abd41c58274471a1384fe3b', 'request_id': 'req-a32cef67-31a9-40ee-a86b-e846042a5279'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.422492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52098d334abd41c58274471a1384fe3b', 'request_id': 'req-a32cef67-31a9-40ee-a86b-e846042a5279'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.429563 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52098d334abd41c58274471a1384fe3b', 'request_id': 'req-a32cef67-31a9-40ee-a86b-e846042a5279'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.440070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] The token cache is being invalidate because project 52098d334abd41c58274471a1384fe3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:35.440353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.440973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.442480 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1192/2403] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:35 2022] DELETE /identity/v3/projects/52098d334abd41c58274471a1384fe3b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:35.446484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:35.457064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa143-6077-4d90-b1ca-8833dc511415 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:35.513583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:35.514200 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:35.514476 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:35.514743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] PATH_INFO: `/v3/users/c6fc0851d02c4109bfd725d007426042` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:35.515859 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fc0851d02c4109bfd725d007426042)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:35.517746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:35.562500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fc0851d02c4109bfd725d007426042'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.563137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fc0851d02c4109bfd725d007426042'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.570563 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fc0851d02c4109bfd725d007426042'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.571193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fc0851d02c4109bfd725d007426042'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.577633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e93dcdb-e05b-4031-8fc7-18d3c35b5432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fc0851d02c4109bfd725d007426042'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.595251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1212/2404] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:02:35 2022] DELETE /identity/v3/users/c6fc0851d02c4109bfd725d007426042 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:35.867748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:35.869663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:35.885221 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cef67-31a9-40ee-a86b-e846042a5279 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:35.942064 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:35.942688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:35.942965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:35.943235 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] PATH_INFO: `/v3/projects/c325291e575c4c889f4b74f7735b82a1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:35.944373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c325291e575c4c889f4b74f7735b82a1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:35.946274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:35.991472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c325291e575c4c889f4b74f7735b82a1', 'request_id': 'req-9bee8f99-b585-4300-8cf1-17c07af30efa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:35.997611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c325291e575c4c889f4b74f7735b82a1', 'request_id': 'req-9bee8f99-b585-4300-8cf1-17c07af30efa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:36.005447 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c325291e575c4c889f4b74f7735b82a1', 'request_id': 'req-9bee8f99-b585-4300-8cf1-17c07af30efa'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:36.016046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] The token cache is being invalidate because project c325291e575c4c889f4b74f7735b82a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:02:36.016329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:36.016935 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9bee8f99-b585-4300-8cf1-17c07af30efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:02:36.018991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1193/2405] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:02:35 2022] DELETE /identity/v3/projects/c325291e575c4c889f4b74f7735b82a1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:36.023812 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.024092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.024360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.037904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:36.046010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:36.047670 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:36.107841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1213/2406] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:36.115544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.115767 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.116037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.135813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:36.136984 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:36.145087 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1194/2407] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:36.149379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.159504 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b37d-d8b5-4456-a5b2-ec7a957e9a3f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.164170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.164766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.165045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.165317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.165959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:02:36.166260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.167868 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.179899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1214/2408] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:02:36.184485 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.190442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:36.194394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb703ef7-4c60-4538-bce7-768d7eeaa64e None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.200842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.201619 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.202104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.202429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.203302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.206049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.232963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1195/2409] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:02:36 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:36.237225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.247161 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eafc9e-bc30-49b8-98d6-14985c1cf679 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.302297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.302884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.303158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.303467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.304090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.305972 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.326716 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1215/2410] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:02:36 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:02:36.331794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.341961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230200-9008-4347-b297-66a5e29fb022 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.347797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.348380 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.348663 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.348963 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.349611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.351203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.361066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1196/2411] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:36.365057 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.375479 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf9ac5-9f47-479e-91b2-11134bab8a67 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.380326 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.380903 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.381174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.381439 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.382072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.383672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e50826-c8ac-486c-a43a-afff38bea378 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.394690 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1216/2412] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:02:36.398634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.408382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62d3a-f6eb-48e6-9bee-d8eaadd8f704 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.413045 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.413678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.413951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.414217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] PATH_INFO: `/v3/projects/ec944d102b354a2da1deab86eed875ca/users/146a73427d2a446392369ae45086d260/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.428932 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec944d102b354a2da1deab86eed875ca, user_id=146a73427d2a446392369ae45086d260, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.431718 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.445273 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1197/2413] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:02:36 2022] PUT /identity/v3/projects/ec944d102b354a2da1deab86eed875ca/users/146a73427d2a446392369ae45086d260/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:02:36.450166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444464cc-d8c1-49ce-aa7e-31b59ea11930 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.450636 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444464cc-d8c1-49ce-aa7e-31b59ea11930 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.450749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444464cc-d8c1-49ce-aa7e-31b59ea11930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.470099 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-444464cc-d8c1-49ce-aa7e-31b59ea11930 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:36.471413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-444464cc-d8c1-49ce-aa7e-31b59ea11930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:36.531014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1217/2414] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:36.540748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:36.542446 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:36.600679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658054c3-e6c0-4940-a226-b4bb13995180 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:36.604340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:36.604934 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:36.605207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:36.605473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:36.614942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:36.616388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:36.625713 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1198/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:37.317380 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc07-5c82-4a50-8e43-a6e9a7901f57 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:37.317665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc07-5c82-4a50-8e43-a6e9a7901f57 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:37.317943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc07-5c82-4a50-8e43-a6e9a7901f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:37.343945 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:37.347564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-bf6bbc07-5c82-4a50-8e43-a6e9a7901f57 None None] MFA Rules not processed for user `146a73427d2a446392369ae45086d260`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:37.349641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-bf6bbc07-5c82-4a50-8e43-a6e9a7901f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:37.415368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1218/2416] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:37.426487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:02:37.428026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:37.484274 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172fd7b-2822-4c4c-a43c-cd669c0bcffd service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:02:37.488588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:02:37.489182 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:37.489455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:37.489716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:37.497991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:02:37.499435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edeaf7-7a93-4ab0-b918-cbb44a49dc80 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:02:37.508252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1199/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:02:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:02:38.864430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38e9c9-e8af-44a2-a522-063c1e0ba0b4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:38.864921 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38e9c9-e8af-44a2-a522-063c1e0ba0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:38.865048 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38e9c9-e8af-44a2-a522-063c1e0ba0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:38.883922 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dc38e9c9-e8af-44a2-a522-063c1e0ba0b4 None None] MFA Rules not processed for user `146a73427d2a446392369ae45086d260`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:38.885111 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc38e9c9-e8af-44a2-a522-063c1e0ba0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:38.891832 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1219/2418] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:02:47.504313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:48.879138 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=29 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:02:55.223323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:02:55.223842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:02:55.223842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:02:55.242542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] MFA Rules not processed for user `146a73427d2a446392369ae45086d260`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:02:55.243758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:02:55.250394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1200/2419] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:02:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:05.237355 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:12.260824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5970c-c022-42fb-8c7d-b88dc1820b80 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:12.261379 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5970c-c022-42fb-8c7d-b88dc1820b80 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:12.261703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5970c-c022-42fb-8c7d-b88dc1820b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:12.302548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-59a5970c-c022-42fb-8c7d-b88dc1820b80 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:12.303793 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-59a5970c-c022-42fb-8c7d-b88dc1820b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:12.386853 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1220/2420] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 18:03:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:12.436737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:12.438203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:12.550624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b36709-c453-4690-8752-e5dc1e5f6717 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:12.555719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:12.556322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:12.556595 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:12.556860 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:12.565853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:12.567468 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:12.575844 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1201/2421] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:16.821550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:16.822385 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:16.822657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:16.849531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] MFA Rules not processed for user `43fbd8e4b0bd4ab7ba7aeb602ba0a693`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:16.851336 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:16.925158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1221/2422] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:03:17.295351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:17.307905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35cb78-70a2-4d6e-b823-7383ce000014 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:17.312149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:17.313036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:17.314115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:17.314410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:17.319522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:17.331670 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:17.333375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d73e9-b5aa-4dbd-ba6a-121da36d7b28 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:17.345749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1202/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:23.212230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:23.214182 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:23.313692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=100 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:23.346372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e4d2b-8c48-4518-b75b-d68f47ddecb6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:23.353110 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:23.353750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:23.354039 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:23.354319 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:23.364798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:23.379673 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:23.381340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:23.401257 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1222/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:27.339706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=53 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:29.073929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:29.074475 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:29.074673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:29.095044 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:29.096392 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:29.103537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1203/2425] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 18:03:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:29.116318 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:29.128074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb906e-9ba7-406f-972e-e45a4416cd56 service placement] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:29.133114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:29.133706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:29.133983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:29.134252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:29.143328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:29.144900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:29.153047 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1223/2426] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:31.149145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.181741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f82d14-b7e4-4d6a-8c42-0a1655580d0a None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.189024 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.189583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.189583 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.189808 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] PATH_INFO: `/v3/users/146a73427d2a446392369ae45086d260` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.190905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=146a73427d2a446392369ae45086d260)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.192855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.240297 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146a73427d2a446392369ae45086d260'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.241039 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146a73427d2a446392369ae45086d260'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.248997 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146a73427d2a446392369ae45086d260'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.249700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146a73427d2a446392369ae45086d260'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.257522 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-babda8b8-3f82-4e9e-b761-c1a4fed56aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146a73427d2a446392369ae45086d260'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.275676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1204/2427] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:03:31 2022] DELETE /identity/v3/users/146a73427d2a446392369ae45086d260 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:03:31.450090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.464761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856923-c523-499c-b5de-046cb9b0d1d5 service swift] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.521483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.522106 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.522411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.522680 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] PATH_INFO: `/v3/projects/ec944d102b354a2da1deab86eed875ca` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.523817 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec944d102b354a2da1deab86eed875ca)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.525698 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.571348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec944d102b354a2da1deab86eed875ca', 'request_id': 'req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.578128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec944d102b354a2da1deab86eed875ca', 'request_id': 'req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.585092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec944d102b354a2da1deab86eed875ca', 'request_id': 'req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.607620 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] The token cache is being invalidate because project ec944d102b354a2da1deab86eed875ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:03:31.607890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.608500 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1874ac07-ddd7-4cc5-bfbc-8100335f5be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:31.610254 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1224/2428] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:03:31 2022] DELETE /identity/v3/projects/ec944d102b354a2da1deab86eed875ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:03:31.615322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.615604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.615868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.672410 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:31.673519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:31.731627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1205/2429] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:31.740026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.740315 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.740590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.760759 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:31.761986 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:31.770113 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1225/2430] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:31.774251 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.783958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9b0a9-0dc9-4c2a-a057-37ee8f20bcbd None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.788599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.789186 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.789465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.789735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.790379 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:03:31.790684 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.792317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.804921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1206/2431] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:03:31.808939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.818715 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93db67-4ccb-46ca-8c5c-853a460895cc None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.823347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.823934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.824212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.824482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.825101 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.826978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.854034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1226/2432] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:03:31 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:03:31.858202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.868538 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e404-5749-40c5-8ab3-a285d7c93d4f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.872063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:31.929142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.929675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.929950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.930215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.930852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.932781 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.954093 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1207/2433] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:03:31 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:03:31.958356 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:31.968627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540eab2-5bd7-47d7-88dc-e8a03d2342b9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:31.973181 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:31.973767 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:31.974044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:31.974313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:31.974957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:31.976582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:31.986807 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1227/2434] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:03:31.990623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:32.001373 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c70e-22a4-47c9-a94c-281463df3113 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:32.005990 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:32.006578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:32.006852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:32.007120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:32.007806 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:32.009394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173f92e-85ad-4a5e-974f-93fb50ecce38 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:32.019443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1208/2435] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:03:32.023339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:32.028423 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:32.034650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aeed-d6c8-4833-b44e-3ae68379ee7e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:32.040499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:32.041172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:32.041453 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:32.041722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] PATH_INFO: `/v3/projects/4c080f294c9d4b08825ff5e54ab3a257/users/f00855d3141d4bb09a9584912cb7fcd0/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:32.056674 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c080f294c9d4b08825ff5e54ab3a257, user_id=f00855d3141d4bb09a9584912cb7fcd0, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:32.059358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:32.072484 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1228/2436] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:03:32 2022] PUT /identity/v3/projects/4c080f294c9d4b08825ff5e54ab3a257/users/f00855d3141d4bb09a9584912cb7fcd0/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:03:32.083893 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:32.084180 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:32.084483 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:32.113047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] MFA Rules not processed for user `f00855d3141d4bb09a9584912cb7fcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:32.114236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:32.177724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1209/2437] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:32.189135 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:32.190820 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:32.248166 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb35e5-596f-48d3-88da-dede5612a58a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:32.251929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:32.252510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:32.252786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:32.253054 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:32.261169 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:32.262582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f320f4-0060-43d8-9bde-a618f3249bd4 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:32.271374 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1229/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:34.812295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:34.873564 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e167-c164-48d1-86dd-2e636105b438 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:34.878864 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:34.879521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:34.879798 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:34.880068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] PATH_INFO: `/v3/users/f00855d3141d4bb09a9584912cb7fcd0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:34.881171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00855d3141d4bb09a9584912cb7fcd0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:34.883094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:34.898333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:34.929493 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00855d3141d4bb09a9584912cb7fcd0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:34.930163 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00855d3141d4bb09a9584912cb7fcd0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:34.937054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00855d3141d4bb09a9584912cb7fcd0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:34.938279 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00855d3141d4bb09a9584912cb7fcd0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:34.944894 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00855d3141d4bb09a9584912cb7fcd0'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:34.962202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1210/2439] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:03:34 2022] DELETE /identity/v3/users/f00855d3141d4bb09a9584912cb7fcd0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:03:34.966835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:34.967340 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:34.967463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:34.986799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:34.988034 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:35.046371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1230/2440] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:35.056738 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.058155 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:35.134763 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91822cad-3a4f-429d-b7c7-08d60dbbefda admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.138404 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.139000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.139291 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.139611 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.148719 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.150142 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1c8a2-5f51-4fdc-87dd-f5827698bf2d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.160408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1211/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:35.426931 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.428429 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:35.441555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c187-f193-4cc1-b323-0200f677c68f None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.447197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.448031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.448387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.448573 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] PATH_INFO: `/v3/projects/4c080f294c9d4b08825ff5e54ab3a257` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.449692 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c080f294c9d4b08825ff5e54ab3a257)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.451625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.498545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c080f294c9d4b08825ff5e54ab3a257', 'request_id': 'req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:35.505443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c080f294c9d4b08825ff5e54ab3a257', 'request_id': 'req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:35.511973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c080f294c9d4b08825ff5e54ab3a257', 'request_id': 'req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:35.522611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] The token cache is being invalidate because project 4c080f294c9d4b08825ff5e54ab3a257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:03:35.522893 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:35.523539 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b62d4c30-a1a7-4baa-a3f3-809b8eebbc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:35.525010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1231/2442] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:03:35 2022] DELETE /identity/v3/projects/4c080f294c9d4b08825ff5e54ab3a257 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:03:35.530214 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.530526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.530815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.550657 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:35.551886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:35.609166 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1212/2443] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:35.616849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.617128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.617394 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.625942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:35.637642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:35.639507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:35.648185 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1232/2444] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:35.652322 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.662465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded239b3-550f-49d7-b798-86b7a25964cc None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.666948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.667558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.667832 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.668096 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.668729 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:03:35.669030 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.670636 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.682150 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1213/2445] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:03:35.686295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.695718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f55a41-af36-494f-be91-89656c22e95d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.700402 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.701028 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.701310 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.701582 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.702225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.704914 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.731973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1233/2446] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:03:35 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:03:35.736285 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.742554 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:35.746520 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a3a7-876e-4db7-8979-418b58c36da1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.802916 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.803544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.803821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.804089 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.804716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.806630 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.830928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1214/2447] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:03:35 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:03:35.832368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.842941 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f40c-c262-4084-8db6-e4605a914f0c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.848338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.848929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.849209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.849483 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.850124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.851764 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.862201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1234/2448] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:03:35.866002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.876037 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d826-742c-44fb-8e0e-10fc25b7764f admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.880652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.881239 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.881526 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.881790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.882423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.884063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb182b19-1dc8-4089-b23b-2d59c1dc7038 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.895236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1215/2449] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:03:35.898983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:35.909330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973347-febb-4a44-9de1-faa6769f2f76 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:35.914077 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:35.914714 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.914995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.915262 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] PATH_INFO: `/v3/projects/b2addf42ae48435e97ce5d004bd8a010/users/a94d1863b9f044fc9a35062fe0a558e8/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.930774 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2addf42ae48435e97ce5d004bd8a010, user_id=a94d1863b9f044fc9a35062fe0a558e8, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:35.933436 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:35.946044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1235/2450] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:03:35 2022] PUT /identity/v3/projects/b2addf42ae48435e97ce5d004bd8a010/users/a94d1863b9f044fc9a35062fe0a558e8/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:03:35.957206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66796-24fd-469d-be23-4be4239db9a8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:35.957489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66796-24fd-469d-be23-4be4239db9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:35.957758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a66796-24fd-469d-be23-4be4239db9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:35.986068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-81a66796-24fd-469d-be23-4be4239db9a8 None None] MFA Rules not processed for user `a94d1863b9f044fc9a35062fe0a558e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:35.987249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-81a66796-24fd-469d-be23-4be4239db9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:36.050448 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1216/2451] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:36.061122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:36.062837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:36.138347 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b761f5-8b83-4ae9-86ad-f27f97915c29 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:36.142297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:36.142886 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:36.143162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:36.143464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:36.151577 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:36.152987 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78a642-ce54-4bd8-97aa-a5ba613cda6a service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:36.162391 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1236/2452] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:37.517135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:37.517627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:37.517627 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:37.536676 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] MFA Rules not processed for user `a94d1863b9f044fc9a35062fe0a558e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:37.537855 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:37.544639 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1217/2453] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:46.158236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=60,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:47.531869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:52.464709 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582569e-4388-4748-a482-cea4cedb4e4e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:52.465211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582569e-4388-4748-a482-cea4cedb4e4e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:52.465305 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582569e-4388-4748-a482-cea4cedb4e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:52.485454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-3582569e-4388-4748-a482-cea4cedb4e4e None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:52.486656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3582569e-4388-4748-a482-cea4cedb4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:52.542236 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1237/2454] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 18:03:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:52.554733 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:52.556248 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:52.623225 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeda49e-98bf-4e4b-af75-7a5e90b0dfe1 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:52.628146 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:52.628735 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:52.629005 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:52.629271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:52.637418 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:52.638998 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:52.647017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1218/2455] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:53.146583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa483-ed22-4db1-8471-77dc8755a533 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.146874 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa483-ed22-4db1-8471-77dc8755a533 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.147149 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aa483-ed22-4db1-8471-77dc8755a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.167376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-737aa483-ed22-4db1-8471-77dc8755a533 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:53.168561 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-737aa483-ed22-4db1-8471-77dc8755a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:53.176784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1238/2456] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:53.188930 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:53.199362 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4392e-a82c-4bab-96b6-4443e815eaeb service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:53.204444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:53.205270 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.205539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.205829 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.213558 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:53.215110 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:53.223495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1219/2457] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:53.445950 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86006-10bf-48da-862f-a50a0bb976ae None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.446237 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86006-10bf-48da-862f-a50a0bb976ae None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.446514 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86006-10bf-48da-862f-a50a0bb976ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.466840 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-a8c86006-10bf-48da-862f-a50a0bb976ae None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:53.468068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a8c86006-10bf-48da-862f-a50a0bb976ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:53.476132 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1239/2458] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Oct 14 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:53.487842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:53.498361 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149f6d-ce9c-401e-906b-c778f6d81629 service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:53.503365 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:53.503975 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.504250 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.504515 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.512412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:53.513962 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:53.522391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1220/2459] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:53.838735 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.839020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.839320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.859465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] MFA Rules not processed for user `2ab6855876ed4c90944d2545f8682e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:53.860656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:53.867827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1240/2460] 10.222.0.26 () {58 vars in 967 bytes} [Fri Oct 14 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:53.879999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:53.890736 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28804ae-19f9-46a5-8eba-4fc412a9762a service swift] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:53.895679 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565161def47f4b29a23f10fce8783d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:53.896271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:53.896548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:53.896816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:53.904815 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:53.906967 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996afa88-5149-4407-b481-7465e300ddfb service swift] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:53.914983 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1221/2461] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Oct 14 18:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 18:03:55.995916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:56.057983 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3e9c-b896-41ac-996e-19f8f58167c8 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:56.063020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:56.063663 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:56.063936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:56.064201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] PATH_INFO: `/v3/users/a94d1863b9f044fc9a35062fe0a558e8` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:56.065329 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94d1863b9f044fc9a35062fe0a558e8)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:56.067221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:56.112260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94d1863b9f044fc9a35062fe0a558e8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.112897 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94d1863b9f044fc9a35062fe0a558e8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.119751 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94d1863b9f044fc9a35062fe0a558e8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.120372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94d1863b9f044fc9a35062fe0a558e8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.127956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94d1863b9f044fc9a35062fe0a558e8'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.146037 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1241/2462] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:03:55 2022] DELETE /identity/v3/users/a94d1863b9f044fc9a35062fe0a558e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:03:56.150411 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:56.150955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:56.150955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:56.169908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:03:56.171135 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:56.229028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1222/2463] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:03:56.238783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:56.240195 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:56.246713 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:56.299187 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06e5e-b806-46d3-bb48-a781ca354e70 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:56.302835 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:56.303468 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:56.303745 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:56.304016 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:56.313602 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:56.315017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:56.324362 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1242/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:03:56.490500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:03:56.492383 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:03:56.505071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19ecb1-6dcd-4770-8629-8da2df670894 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:03:56.509628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:03:56.510295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:03:56.510552 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:03:56.510816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] PATH_INFO: `/v3/projects/b2addf42ae48435e97ce5d004bd8a010` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:03:56.511941 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2addf42ae48435e97ce5d004bd8a010)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:03:56.513836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:03:56.558820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:03:56.562799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2addf42ae48435e97ce5d004bd8a010', 'request_id': 'req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.570246 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2addf42ae48435e97ce5d004bd8a010', 'request_id': 'req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.578557 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2addf42ae48435e97ce5d004bd8a010', 'request_id': 'req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.589059 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] The token cache is being invalidate because project b2addf42ae48435e97ce5d004bd8a010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:03:56.589346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.589972 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:03:56.591476 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1223/2465] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:03:56 2022] DELETE /identity/v3/projects/b2addf42ae48435e97ce5d004bd8a010 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:06.320142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=24 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:06.586062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:28.413448 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:28.415119 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:28.434007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc15003-3501-47fc-b702-637aa278a162 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:28.489096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:28.489766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:28.490042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:28.490312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] PATH_INFO: `/v3/users/43fbd8e4b0bd4ab7ba7aeb602ba0a693` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:28.491727 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fbd8e4b0bd4ab7ba7aeb602ba0a693)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:28.493790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:28.548225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fbd8e4b0bd4ab7ba7aeb602ba0a693'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.548923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fbd8e4b0bd4ab7ba7aeb602ba0a693'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.556821 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fbd8e4b0bd4ab7ba7aeb602ba0a693'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.557555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fbd8e4b0bd4ab7ba7aeb602ba0a693'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.565827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-0e8fb157-fa7c-4482-8920-bf18d2087b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fbd8e4b0bd4ab7ba7aeb602ba0a693'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.584946 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1243/2466] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:04:28 2022] DELETE /identity/v3/users/43fbd8e4b0bd4ab7ba7aeb602ba0a693 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:28.852347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:28.854390 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:28.868393 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b4a5a-94a6-48c7-a81d-35a85a9918db admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:28.924699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:28.925244 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:28.925516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:28.925784 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] PATH_INFO: `/v3/projects/5d028c23f7594abbbf9fdf20a1f02850` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:28.926877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d028c23f7594abbbf9fdf20a1f02850)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:28.928800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:28.974317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d028c23f7594abbbf9fdf20a1f02850', 'request_id': 'req-e1ba9ef5-4393-4317-80d9-228cc35839f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.980394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d028c23f7594abbbf9fdf20a1f02850', 'request_id': 'req-e1ba9ef5-4393-4317-80d9-228cc35839f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.987510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d028c23f7594abbbf9fdf20a1f02850', 'request_id': 'req-e1ba9ef5-4393-4317-80d9-228cc35839f8'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.998241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] The token cache is being invalidate because project 5d028c23f7594abbbf9fdf20a1f02850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:04:28.998537 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:28.999161 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-e1ba9ef5-4393-4317-80d9-228cc35839f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:29.000667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1224/2467] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:04:28 2022] DELETE /identity/v3/projects/5d028c23f7594abbbf9fdf20a1f02850 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:29.005526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.005814 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.006090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.026083 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:04:29.027304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:29.086203 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1244/2468] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:04:29.095396 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.095678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.095946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.115187 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:04:29.116403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:29.124821 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1225/2469] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:04:29.129008 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.139445 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6589b-a975-401b-b84c-594a3b03e9e4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.144178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.144762 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.145045 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.145314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.145952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:04:29.146252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.147857 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.159320 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1245/2470] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:04:29.163546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.172813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3563b-0b1e-4481-9a71-b8144036771b None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.177530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.178057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.178335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.178607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.179226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.181156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.209944 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1226/2471] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:04:29.213995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.224107 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76945d4-b89e-4368-8cbd-c7a2da534fc7 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.227720 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:29.282442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.283038 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.283334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.283604 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.284229 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.286178 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.306741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1246/2472] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:04:29.311408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.321560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341b959-7d01-48e0-a950-25021bbac27e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.326040 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.327196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.327496 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.327764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.328394 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.330234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.340189 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1227/2473] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:04:29.344156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.354267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e305b-007e-4795-859b-9f792d32cb76 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.360051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.360642 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.360934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.361193 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.361842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.363464 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0983-b2cb-419d-be7e-66721265b22b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.374653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1247/2474] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:04:29.378723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.388478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb708-f1c0-4461-8955-00d558bb295c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.393924 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.394632 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.394912 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.395185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] PATH_INFO: `/v3/projects/90d1684cfaad4d7cb84cb7e4410bcc5a/users/be4fa6ca58c84e90a930511715852a3a/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.409609 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d1684cfaad4d7cb84cb7e4410bcc5a, user_id=be4fa6ca58c84e90a930511715852a3a, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.412387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.425002 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1228/2475] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:04:29 2022] PUT /identity/v3/projects/90d1684cfaad4d7cb84cb7e4410bcc5a/users/be4fa6ca58c84e90a930511715852a3a/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:29.435201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.436251 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.436388 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.468188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] MFA Rules not processed for user `be4fa6ca58c84e90a930511715852a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:04:29.469811 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:29.537884 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1248/2476] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:04:29.542347 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.572653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:29.609653 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c4206-c76f-4cc6-8156-a01fbbaff09e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.615861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.616567 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.616850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.617152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.618421 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.620892 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.648724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1229/2477] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:04:29.652833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.664197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6530f46-4b88-4747-bd90-e7b34189356d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.721583 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.722175 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.722458 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.722726 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.723404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.725321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.748547 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1249/2478] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:04:29.749996 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.760301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831fee-13fa-470d-a3aa-8d6f09bbb8bd admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.765841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.766443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.766720 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.766989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.767668 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.769346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.779184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1230/2479] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:04:29.783737 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.790026 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:29.793827 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18e7f-0b4d-4577-a01a-ca064193b8c4 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.799697 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.800339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.800611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.800876 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] PATH_INFO: `/v3/projects/734a2b9c475644819a31169b346f3af0/users/f96899ef0fbf4ee696bcf6b58cf0bf13/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.817280 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734a2b9c475644819a31169b346f3af0, user_id=f96899ef0fbf4ee696bcf6b58cf0bf13, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.820035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.833823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1250/2480] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:04:29 2022] PUT /identity/v3/projects/734a2b9c475644819a31169b346f3af0/users/f96899ef0fbf4ee696bcf6b58cf0bf13/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:29.837796 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.847865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdda3f-9565-4065-ad01-1ee68af75dce admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.903747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.904981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.905326 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.905669 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.906312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.907950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36ce12-004a-4002-aec3-3ae6bdb6b9a4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.921081 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1231/2481] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:04:29.922386 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:29.932669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c9b99-347d-4b15-ad58-22fe217b6c50 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:29.937917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:29.938566 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.938836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.939628 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] PATH_INFO: `/v3/projects/734a2b9c475644819a31169b346f3af0/users/f96899ef0fbf4ee696bcf6b58cf0bf13/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.941072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734a2b9c475644819a31169b346f3af0, user_id=f96899ef0fbf4ee696bcf6b58cf0bf13, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:29.943810 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:29.955844 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1251/2482] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:04:29 2022] PUT /identity/v3/projects/734a2b9c475644819a31169b346f3af0/users/f96899ef0fbf4ee696bcf6b58cf0bf13/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:29.966351 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:29.966782 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:29.967085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:29.994439 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] MFA Rules not processed for user `f96899ef0fbf4ee696bcf6b58cf0bf13`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:04:29.995831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:30.070149 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1232/2483] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:04:30.082498 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:30.084252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:30.140656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00495619-a2c6-4d21-b4e5-4e8c8053a817 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:30.144216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:30.144799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:30.145072 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:30.145337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:30.153939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:30.155430 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:30.164508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1252/2484] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:04:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:04:30.243375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:30.253486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74206e2a-624d-4bac-bd93-a44845cff132 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:30.257041 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:30.257628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:30.257899 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:30.258164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:30.276541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:30.314386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:30.315842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:30.324500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1233/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:04:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:04:36.055626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:36.057188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:36.135758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a702-9466-4970-bb6a-db237b874437 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:36.140574 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:36.141184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:36.141459 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:36.141722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:36.143538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:36.155641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:36.157978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:36.166981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1253/2486] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:04:36.242836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:36.252377 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f3e19-43e4-4207-b408-5ae4c57e8ec4 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:36.255942 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:36.256530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:36.256801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:36.257066 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:36.258785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:36.347486 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:36.348936 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563350-cc38-4e85-8072-f5b2e8dd4471 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:36.370675 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1234/2487] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:04:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:04:46.162614 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:46.367766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=61 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:04:59.410363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:59.473297 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d4efa-b889-4f13-8379-0f36e9026b8f service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:59.477839 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:59.478463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:59.478743 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:59.479015 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] PATH_INFO: `/v3/users/be4fa6ca58c84e90a930511715852a3a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:59.480201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4fa6ca58c84e90a930511715852a3a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:59.482645 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:59.528936 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4fa6ca58c84e90a930511715852a3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:59.529688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4fa6ca58c84e90a930511715852a3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:59.536658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4fa6ca58c84e90a930511715852a3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:59.537291 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4fa6ca58c84e90a930511715852a3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:59.544919 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4fa6ca58c84e90a930511715852a3a'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:04:59.563014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1254/2488] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:04:59 2022] DELETE /identity/v3/users/be4fa6ca58c84e90a930511715852a3a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:04:59.567491 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:59.567981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:59.568097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:59.587035 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:04:59.588271 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:59.656577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1235/2489] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:04:59.666341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:04:59.667758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:04:59.727769 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c62ec-2f01-483e-8b63-ee5d3543a4cd admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:04:59.732321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:04:59.732951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:04:59.733225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:04:59.733492 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:04:59.742377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:04:59.743830 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:04:59.754688 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1255/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:00.026302 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.027938 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:00.039743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e2f9-1796-427e-83b6-4bb4e51dc736 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.044706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.045329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.045604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.045870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] PATH_INFO: `/v3/projects/90d1684cfaad4d7cb84cb7e4410bcc5a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.046981 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d1684cfaad4d7cb84cb7e4410bcc5a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.048908 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:00.098092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d1684cfaad4d7cb84cb7e4410bcc5a', 'request_id': 'req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.104265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d1684cfaad4d7cb84cb7e4410bcc5a', 'request_id': 'req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.111946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d1684cfaad4d7cb84cb7e4410bcc5a', 'request_id': 'req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.122737 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] The token cache is being invalidate because project 90d1684cfaad4d7cb84cb7e4410bcc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:00.123026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.123672 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.125147 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1236/2491] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:00 2022] DELETE /identity/v3/projects/90d1684cfaad4d7cb84cb7e4410bcc5a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:00.129188 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.139452 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d80269-80a1-497c-9357-fd66a11e04bb service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.157066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:00.196007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.196630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.196900 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.197170 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] PATH_INFO: `/v3/users/f96899ef0fbf4ee696bcf6b58cf0bf13` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.198266 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96899ef0fbf4ee696bcf6b58cf0bf13)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.200771 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:00.245693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96899ef0fbf4ee696bcf6b58cf0bf13'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.246331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96899ef0fbf4ee696bcf6b58cf0bf13'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.253633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96899ef0fbf4ee696bcf6b58cf0bf13'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.254304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96899ef0fbf4ee696bcf6b58cf0bf13'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.261550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-8d64c3af-f3e7-4226-9bce-d52d7193198b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96899ef0fbf4ee696bcf6b58cf0bf13'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.278942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1256/2492] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:00 2022] DELETE /identity/v3/users/f96899ef0fbf4ee696bcf6b58cf0bf13 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:00.543849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.545455 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:00.561156 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd9514-cc3d-4275-8fb4-7d849ce2f263 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.617076 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.617822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.617969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.618290 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] PATH_INFO: `/v3/projects/734a2b9c475644819a31169b346f3af0` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.619434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734a2b9c475644819a31169b346f3af0)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.621357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:00.651830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:00.669357 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734a2b9c475644819a31169b346f3af0', 'request_id': 'req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.675514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734a2b9c475644819a31169b346f3af0', 'request_id': 'req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.683857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734a2b9c475644819a31169b346f3af0', 'request_id': 'req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.698703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] The token cache is being invalidate because project 734a2b9c475644819a31169b346f3af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:00.699018 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.699662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-ed5cafb0-2b04-4c2f-adc9-03c7e7db3b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:00.702011 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1237/2493] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:00 2022] DELETE /identity/v3/projects/734a2b9c475644819a31169b346f3af0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:00.707051 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.707546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.707643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.726909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:00.728115 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:00.785988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1257/2494] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:00.794027 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.794487 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.794764 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.815865 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:00.817057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:00.825772 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1238/2495] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:00.830092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.839934 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a836-0a19-4d43-b6e4-f3b7e484d5ce None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.844784 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.845371 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.845649 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.845917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.846555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:05:00.846855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.848462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:00.860148 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1258/2496] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:05:00.864501 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.874201 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde669-3bfd-4670-a83c-e9338680a5e8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.878836 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.879528 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.879805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.880072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.880724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.882628 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:00.912870 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1239/2497] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:00 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:00.913869 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:00.924035 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc58e5-bb44-4458-bd6e-b3b892c37a88 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:00.951000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:00.985477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:00.986074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:00.986354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:00.986625 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:00.987259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:00.989212 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.010003 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1259/2498] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:00 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:01.014177 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.024405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089214-54bd-41ce-94cb-97fe9a46373e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.029502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.030097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.030424 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.030691 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.031369 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.032974 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.043315 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1240/2499] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:01.047800 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.057548 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d41a0-98b2-4f88-991c-7cdebac1c9f3 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.062728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.063338 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.063622 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.063894 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.064533 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.066094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a22563-34f7-4fd1-86f0-24d0d4e4d204 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.077230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1260/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:01.079928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.089728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2526c-457c-4e3f-a985-dd04e3c39605 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.094316 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.094951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.095228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.095532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] PATH_INFO: `/v3/projects/9cd0ae814d4d4b90a2f7f086762b5eb4/users/468b04ee77ea471f83b981b3a15e5977/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.110438 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd0ae814d4d4b90a2f7f086762b5eb4, user_id=468b04ee77ea471f83b981b3a15e5977, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.113125 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.125140 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1241/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:01 2022] PUT /identity/v3/projects/9cd0ae814d4d4b90a2f7f086762b5eb4/users/468b04ee77ea471f83b981b3a15e5977/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:01.136641 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.136956 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.137228 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.165541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] MFA Rules not processed for user `468b04ee77ea471f83b981b3a15e5977`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:01.166706 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:01.230007 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1261/2502] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:01.234530 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.295548 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61232d33-5fe3-47b0-a8a1-82f127ecc242 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.300174 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.300775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.301057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.301330 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.301958 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.303886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.330535 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1242/2503] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:01 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:01.334600 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.346147 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5d4a-23a6-4f3a-9659-77d53ab3398a None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.400760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.401358 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.401637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.401912 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.402531 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.405282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.428939 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1262/2504] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:01 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:01.429980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.440319 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f62bd-940e-4c42-b419-c1eb9c194231 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.444842 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.445429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.445703 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.445969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.446604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.448210 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.458904 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1243/2505] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:05:01.462841 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.473271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0138c3e-7ecc-4597-8cc1-3037a67afa7f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.477808 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.478437 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.478708 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.478973 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] PATH_INFO: `/v3/projects/ab2d7af58f8c481485ea68537a2809cd/users/9d129a1e6427450c91141a47bf409038/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.493915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2d7af58f8c481485ea68537a2809cd, user_id=9d129a1e6427450c91141a47bf409038, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.496650 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.509368 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1263/2506] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:01 2022] PUT /identity/v3/projects/ab2d7af58f8c481485ea68537a2809cd/users/9d129a1e6427450c91141a47bf409038/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:01.513277 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.522913 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e48e1-6b9a-45af-b781-1c9ed672dbac admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.542385 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:01.579283 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.580168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.580442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.580706 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.581335 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.582910 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e182935-debe-4a93-b56c-2e0673409c53 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.592969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1244/2507] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:01.597174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.602413 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:01.609360 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7de4c-3ddf-42d5-8f22-ce8bbacd99ca admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.614036 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.614665 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.614938 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.615205 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] PATH_INFO: `/v3/projects/ab2d7af58f8c481485ea68537a2809cd/users/9d129a1e6427450c91141a47bf409038/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.617120 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2d7af58f8c481485ea68537a2809cd, user_id=9d129a1e6427450c91141a47bf409038, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.619776 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.630234 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1264/2508] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:01 2022] PUT /identity/v3/projects/ab2d7af58f8c481485ea68537a2809cd/users/9d129a1e6427450c91141a47bf409038/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:01.640402 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.640909 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.641068 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.668358 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] MFA Rules not processed for user `9d129a1e6427450c91141a47bf409038`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:01.670157 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:01.737851 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1245/2509] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:01.749282 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:01.751044 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:01.811378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dca3b-4032-46f7-9550-86a5814073ef admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:01.814978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:01.815610 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:01.815890 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:01.816163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:01.825606 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:01.827031 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2457-be06-434c-b9a1-2de4a9f72c08 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:01.836847 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1265/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:02.220265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:02.283026 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2e2b3-9889-4f7a-abc9-a2820b58b4a0 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:02.287549 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:02.288164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:02.288436 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:02.288702 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] PATH_INFO: `/v3/users/468b04ee77ea471f83b981b3a15e5977` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:02.289793 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468b04ee77ea471f83b981b3a15e5977)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:02.291731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:02.336407 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468b04ee77ea471f83b981b3a15e5977'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.337034 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468b04ee77ea471f83b981b3a15e5977'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.338217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:02.346164 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468b04ee77ea471f83b981b3a15e5977'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.346777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468b04ee77ea471f83b981b3a15e5977'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.353168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468b04ee77ea471f83b981b3a15e5977'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.370800 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1246/2511] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:02 2022] DELETE /identity/v3/users/468b04ee77ea471f83b981b3a15e5977 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:02.375267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:02.375569 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:02.375842 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:02.394635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:02.395855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:02.454786 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1266/2512] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:02.464241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:02.466343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:02.522085 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea4467-c954-4295-b437-13c4443c8c22 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:02.525728 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:02.526312 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:02.526587 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:02.526854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:02.536473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:02.537905 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:02.547432 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1247/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:02.815717 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:02.817155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:02.830766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd3bc-9cb5-42ab-8a56-b36c9ddfbf69 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:02.836158 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:02.836799 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:02.837137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:02.837421 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] PATH_INFO: `/v3/projects/9cd0ae814d4d4b90a2f7f086762b5eb4` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:02.838554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd0ae814d4d4b90a2f7f086762b5eb4)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:02.840775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:02.888114 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd0ae814d4d4b90a2f7f086762b5eb4', 'request_id': 'req-75b34008-0cdc-4b69-ae37-f6cc78258788'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.895011 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd0ae814d4d4b90a2f7f086762b5eb4', 'request_id': 'req-75b34008-0cdc-4b69-ae37-f6cc78258788'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.901244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd0ae814d4d4b90a2f7f086762b5eb4', 'request_id': 'req-75b34008-0cdc-4b69-ae37-f6cc78258788'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.912313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] The token cache is being invalidate because project 9cd0ae814d4d4b90a2f7f086762b5eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:02.912598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.913244 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:02.914728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1267/2514] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:02 2022] DELETE /identity/v3/projects/9cd0ae814d4d4b90a2f7f086762b5eb4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:02.919360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:02.929078 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ec23-d2dd-49de-9385-1f4e1dc3712d service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:02.985198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:02.985820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:02.986094 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:02.986386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] PATH_INFO: `/v3/users/9d129a1e6427450c91141a47bf409038` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:02.987502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d129a1e6427450c91141a47bf409038)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:02.989444 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.035428 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d129a1e6427450c91141a47bf409038'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.036071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d129a1e6427450c91141a47bf409038'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.042820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d129a1e6427450c91141a47bf409038'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.043469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d129a1e6427450c91141a47bf409038'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.050951 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-662a305d-1028-4870-a489-7f1be29975de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d129a1e6427450c91141a47bf409038'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.056232 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:03.074148 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1248/2515] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:02 2022] DELETE /identity/v3/users/9d129a1e6427450c91141a47bf409038 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:05:03.355627 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.357567 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:03.370795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34008-0cdc-4b69-ae37-f6cc78258788 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.383121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:03.430865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.431522 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.431801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.432069 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] PATH_INFO: `/v3/projects/ab2d7af58f8c481485ea68537a2809cd` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.433172 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2d7af58f8c481485ea68537a2809cd)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.435976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.483750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2d7af58f8c481485ea68537a2809cd', 'request_id': 'req-1b17f9d4-d39d-4200-9830-962796856c62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.490875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2d7af58f8c481485ea68537a2809cd', 'request_id': 'req-1b17f9d4-d39d-4200-9830-962796856c62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.498081 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2d7af58f8c481485ea68537a2809cd', 'request_id': 'req-1b17f9d4-d39d-4200-9830-962796856c62'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.508678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] The token cache is being invalidate because project ab2d7af58f8c481485ea68537a2809cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:03.508958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.509588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-1b17f9d4-d39d-4200-9830-962796856c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:03.511058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1268/2516] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:03 2022] DELETE /identity/v3/projects/ab2d7af58f8c481485ea68537a2809cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:03.517015 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.517293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.517586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.536914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:03.538105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:03.596566 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1249/2517] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:03.604267 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.604652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.604913 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.625571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:03.626760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:03.636325 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1269/2518] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:03.640598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.650228 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3ce7c-0041-439a-b379-4c9cd9ecbab7 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.655673 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.656295 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.656572 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.656839 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.657502 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:05:03.657801 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.659473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.671542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1250/2519] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:05:03.675658 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.684929 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eba28e-de1e-44eb-b96b-ec43d4f911d4 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.689777 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.690367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.690669 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.690953 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.691653 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.693545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.721208 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1270/2520] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:03 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:05:03.725260 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.736313 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae79e7-a35e-4a0d-940b-9d70a6ab40f9 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.791623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.792217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.792498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.792766 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.793495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.796915 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.818403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1251/2521] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:03 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:03.822995 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.834295 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe71b8-c254-432f-96ce-2ad0387dff12 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.838861 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.839487 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.839760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.840029 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.841226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.842895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.853443 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1271/2522] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:03.857978 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.867985 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73708cc-588c-4cab-989d-b13de34cf7e1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.872616 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.873200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.873473 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.873758 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.874388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.876008 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3d6c-bc7b-4955-a641-e898d7d706b1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.886629 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1252/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:03.890746 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:03.900489 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e881-8412-4502-a482-2b40be39b706 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:03.905719 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:03.906349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:03.906624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:03.906891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] PATH_INFO: `/v3/projects/13ddc37a379745c4a5bd60834f56aff6/users/ecd5865a98734feba6d1365022b01a82/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:03.921959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ddc37a379745c4a5bd60834f56aff6, user_id=ecd5865a98734feba6d1365022b01a82, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:03.924611 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:03.937597 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1272/2524] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:03 2022] PUT /identity/v3/projects/13ddc37a379745c4a5bd60834f56aff6/users/ecd5865a98734feba6d1365022b01a82/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:04.003524 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.004100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.004100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.032498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] MFA Rules not processed for user `ecd5865a98734feba6d1365022b01a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:04.033687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:04.073038 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:04.098685 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1253/2525] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:04.103151 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.146916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:04.165088 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf836b9-2497-4033-8120-409dfdbb632d admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.169750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.170345 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.170623 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.170895 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.171556 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.173444 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.198463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1273/2526] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:04 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:04.203387 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.214145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea81e6-5c96-4f61-8dd6-cc0ee2d0b726 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.269298 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.269896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.270169 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.270442 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.271092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.273062 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.293777 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1254/2527] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:04 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:04.297750 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.307942 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc389c-3387-422f-a413-87d455612274 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.313052 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.313634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.313909 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.314173 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.314806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.316396 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.327339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1274/2528] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:04.331573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.342014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7f702-768e-436c-8b4e-f95351e1b834 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.346794 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.347469 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.347748 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.348010 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] PATH_INFO: `/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45/users/db11efb1c53b45639bc5099d8e320d20/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.362545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7db7bffa404a4fbeb4fff20473ad45, user_id=db11efb1c53b45639bc5099d8e320d20, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.365236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.378138 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1255/2529] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:04 2022] PUT /identity/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45/users/db11efb1c53b45639bc5099d8e320d20/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:04.382163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.392042 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e420eb-dc25-4fde-b4de-20b88d44573e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.446634 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.447432 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.447615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.447959 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.448805 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.450661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd217-5ece-49ca-8485-e242f0fe20b0 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.460779 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1275/2530] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:04.464999 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.475708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc88-b3bb-448d-8d2c-d2a6cc588ad8 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.480345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.481054 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.481332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.481599 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] PATH_INFO: `/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45/users/db11efb1c53b45639bc5099d8e320d20/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.483519 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7db7bffa404a4fbeb4fff20473ad45, user_id=db11efb1c53b45639bc5099d8e320d20, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.486136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.496048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1256/2531] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:04 2022] PUT /identity/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45/users/db11efb1c53b45639bc5099d8e320d20/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:04.506615 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.506899 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.507174 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.535058 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] MFA Rules not processed for user `db11efb1c53b45639bc5099d8e320d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:04.536292 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:04.602241 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1276/2532] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:04.612954 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:04.614597 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:04.673234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eef6d-c12f-45bd-bd5d-d9ed80ccc38d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:04.676970 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:04.677575 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:04.677852 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:04.678121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:04.726105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:04.736799 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:04.738241 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fc605-853f-42ac-837b-b96bfee6e2ce service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:04.747100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1257/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:07.273399 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:07.313991 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:07.337104 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784a2d6-bc59-4d5d-a37c-1f92948cac06 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:07.341906 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:07.342538 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:07.342801 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:07.343070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] PATH_INFO: `/v3/users/ecd5865a98734feba6d1365022b01a82` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:07.344225 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd5865a98734feba6d1365022b01a82)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:07.346128 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:07.391647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd5865a98734feba6d1365022b01a82'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.392293 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd5865a98734feba6d1365022b01a82'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.399322 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd5865a98734feba6d1365022b01a82'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.399957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd5865a98734feba6d1365022b01a82'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.408073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd5865a98734feba6d1365022b01a82'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.425348 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1277/2534] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:07 2022] DELETE /identity/v3/users/ecd5865a98734feba6d1365022b01a82 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:07.429760 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:07.430236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:07.430340 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:07.451857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:07.453071 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:07.511472 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1258/2535] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:07.521660 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:07.523032 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:07.580526 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8865614-c74d-4cfa-8048-026d1fcf54d6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:07.584631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:07.585235 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:07.585513 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:07.585783 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:07.594982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:07.596447 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:07.605728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1278/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:07.877434 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:07.879206 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:07.891802 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6acb7-2607-4ede-b901-f05826df41d8 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:07.896495 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:07.897188 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:07.897465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:07.897741 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] PATH_INFO: `/v3/projects/13ddc37a379745c4a5bd60834f56aff6` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:07.898882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ddc37a379745c4a5bd60834f56aff6)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:07.900843 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:07.947001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ddc37a379745c4a5bd60834f56aff6', 'request_id': 'req-32ae9156-57b3-4799-b6e5-0abbba3385e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.953333 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ddc37a379745c4a5bd60834f56aff6', 'request_id': 'req-32ae9156-57b3-4799-b6e5-0abbba3385e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.960710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ddc37a379745c4a5bd60834f56aff6', 'request_id': 'req-32ae9156-57b3-4799-b6e5-0abbba3385e3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.970971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] The token cache is being invalidate because project 13ddc37a379745c4a5bd60834f56aff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:07.971252 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.971900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:07.973371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1259/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:07 2022] DELETE /identity/v3/projects/13ddc37a379745c4a5bd60834f56aff6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:07.977312 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:07.987434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847b133-0605-4007-8ea2-0d1009281f89 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.042541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.043163 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.044065 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.044344 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] PATH_INFO: `/v3/users/db11efb1c53b45639bc5099d8e320d20` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.045462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db11efb1c53b45639bc5099d8e320d20)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.047470 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.048883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:08.095376 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db11efb1c53b45639bc5099d8e320d20'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.096017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db11efb1c53b45639bc5099d8e320d20'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.102804 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db11efb1c53b45639bc5099d8e320d20'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.103456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db11efb1c53b45639bc5099d8e320d20'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.111156 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dd4589ca-667b-477b-9639-8a0896be39d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db11efb1c53b45639bc5099d8e320d20'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.128207 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1279/2538] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:07 2022] DELETE /identity/v3/users/db11efb1c53b45639bc5099d8e320d20 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:08.393115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.394542 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:08.408826 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9156-57b3-4799-b6e5-0abbba3385e3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.468820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.469498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.469710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.469977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] PATH_INFO: `/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.471074 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7db7bffa404a4fbeb4fff20473ad45)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.473004 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.488539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:08.519872 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7db7bffa404a4fbeb4fff20473ad45', 'request_id': 'req-a4b76eee-17ff-4bb4-989f-d641cd544bd9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.525877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7db7bffa404a4fbeb4fff20473ad45', 'request_id': 'req-a4b76eee-17ff-4bb4-989f-d641cd544bd9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.533471 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7db7bffa404a4fbeb4fff20473ad45', 'request_id': 'req-a4b76eee-17ff-4bb4-989f-d641cd544bd9'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.543621 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] The token cache is being invalidate because project 5d7db7bffa404a4fbeb4fff20473ad45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:08.543900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.544514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-a4b76eee-17ff-4bb4-989f-d641cd544bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:08.545980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1260/2539] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:08 2022] DELETE /identity/v3/projects/5d7db7bffa404a4fbeb4fff20473ad45 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:08.550836 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.551339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.551456 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.570710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:08.571863 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:08.628766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1280/2540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:08.636106 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.636388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.636658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.657514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:08.658710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:08.666541 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1261/2541] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:08.670923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.680546 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a467be-b45b-4dbf-8fee-925f98206c43 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.685415 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.686012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.686285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.686554 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.687198 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:05:08.687525 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.689112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.701442 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1281/2542] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:05:08.705991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.716057 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb013de-7449-4e19-9cf3-5513891673a5 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.720711 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.721301 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.721581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.721850 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.722478 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.724416 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.759371 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1262/2543] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:08 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:08.764197 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.773915 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9697d-e92c-4534-add1-91a75b1acf1a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.830467 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.830996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.831304 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.831588 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.832214 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.834122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.845046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:08.856916 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1282/2544] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:08 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:08.861073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.872017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73691a66-73cc-4188-a94f-b1e1c15e7522 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.876723 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.877320 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.877596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.877863 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.878494 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.880115 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.890647 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1263/2545] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:08.894460 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.905159 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d73ae-80b6-440c-9119-e158188f22f9 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.909742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.910323 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.910598 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.910865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.911541 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.913112 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe9d24-a15f-4c4e-8d4d-92ef815a2243 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.923966 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1283/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:08.927927 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:08.938341 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255ba3b-20c0-4860-818a-9a069a52fd4a admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:08.942867 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:08.943529 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.943805 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.944072 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] PATH_INFO: `/v3/projects/0b2a71819f9b4b4eb626d47f64a5b1b2/users/61706fbf156a4697b3f6c6a0b4906fca/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:08.959671 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2a71819f9b4b4eb626d47f64a5b1b2, user_id=61706fbf156a4697b3f6c6a0b4906fca, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:08.962391 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:08.974988 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1264/2547] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:08 2022] PUT /identity/v3/projects/0b2a71819f9b4b4eb626d47f64a5b1b2/users/61706fbf156a4697b3f6c6a0b4906fca/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:08.986782 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:08.987075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:08.987389 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.014865 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] MFA Rules not processed for user `61706fbf156a4697b3f6c6a0b4906fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:09.016103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:09.078988 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1284/2548] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:09.083911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.144678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883877c-9895-4b93-95ee-adbc25a1742c admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.149308 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.149900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.150183 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.150440 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.151060 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.153573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.179375 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1265/2549] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:09.183353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.194373 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc0e7-110a-46b6-a011-803993df6e78 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.250640 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.251247 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.251550 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.251823 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.252463 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.254404 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.277313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1285/2550] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:09.279406 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.289561 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d81c2d-670a-44a4-a009-a7acefe25534 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.294452 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.295049 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.295360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.295631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.296266 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.297861 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.308231 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1266/2551] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 18:05:09.312255 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.321849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee723815-94ec-41f8-9a89-c699bae731ec admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.327053 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.327666 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.327940 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.328204 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.328833 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.330656 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff3ebb-48b6-4dd1-8302-302079d7b61d admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.341074 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1286/2552] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:09.344886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.351635 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:09.355103 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e75a0-6b24-48f1-a1b2-6a65392c1846 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.361136 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.361946 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.362408 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.362725 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] PATH_INFO: `/v3/projects/53a3c3ec42c84c35b6acaa814045c3a7/users/879ca7ae5b9541f6a5586d5ba75f3c18/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.377220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a3c3ec42c84c35b6acaa814045c3a7, user_id=879ca7ae5b9541f6a5586d5ba75f3c18, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.379889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.392914 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1267/2553] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:09 2022] PUT /identity/v3/projects/53a3c3ec42c84c35b6acaa814045c3a7/users/879ca7ae5b9541f6a5586d5ba75f3c18/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:09.403515 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.403802 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.404071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.430878 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] MFA Rules not processed for user `879ca7ae5b9541f6a5586d5ba75f3c18`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:09.432102 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:09.473591 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:09.498190 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1287/2554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:09.502747 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.563353 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec5d-f36d-43de-b49d-19e1006f3539 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.567866 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.568457 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.568726 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.568989 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.569598 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.571510 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.597533 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1268/2555] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:05:09.601555 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.612881 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359315a-d985-40f6-b6d9-891c506cb9ab None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.671855 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.672454 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.672728 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.672992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] PATH_INFO: `/v3/users` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.673618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.675549 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.697377 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1288/2556] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:09.701570 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.711969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538737be-1eb2-4ec7-8bdd-8b6ed2f14ce4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.717070 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.717658 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.717950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.718198 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.718830 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.720456 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.732423 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1269/2557] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:09.736703 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.747223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de4572-85e9-442b-afd2-9a233264f5bc admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.752420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.753066 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.753349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.753626 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] PATH_INFO: `/v3/projects/f19be96170c848bcab6c9eabfda1048c/users/2ce7f8b4b303421bbcc08eafd6c8d5e1/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.768918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19be96170c848bcab6c9eabfda1048c, user_id=2ce7f8b4b303421bbcc08eafd6c8d5e1, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.771618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.785300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1289/2558] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:09 2022] PUT /identity/v3/projects/f19be96170c848bcab6c9eabfda1048c/users/2ce7f8b4b303421bbcc08eafd6c8d5e1/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:09.789249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.799661 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9ff6a-cc3c-4993-9c78-e8e373cde0cc admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.859100 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.859654 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.859928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.860193 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.860820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.862388 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b86b39-df7f-4d67-9191-3c7d336015d9 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.872120 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1270/2559] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:09.876353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:09.886499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e744d-ffef-4e74-964e-786457b1b821 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:09.891364 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:09.891996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.892269 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.892534 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] PATH_INFO: `/v3/projects/f19be96170c848bcab6c9eabfda1048c/users/2ce7f8b4b303421bbcc08eafd6c8d5e1/roles/87f9d55d22b7471e941216189675256a` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.894451 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19be96170c848bcab6c9eabfda1048c, user_id=2ce7f8b4b303421bbcc08eafd6c8d5e1, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:09.897096 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:09.907678 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1290/2560] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:09 2022] PUT /identity/v3/projects/f19be96170c848bcab6c9eabfda1048c/users/2ce7f8b4b303421bbcc08eafd6c8d5e1/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:05:09.919556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:09.919838 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:09.920109 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:09.947868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] MFA Rules not processed for user `2ce7f8b4b303421bbcc08eafd6c8d5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:09.949083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:09.989556 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:10.018957 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1271/2561] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:10.031012 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:10.032732 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:10.088935 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3282d-c2a7-493b-908f-7e44688dbb9e admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:10.093121 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:10.093705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:10.093978 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:10.094243 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:10.139014 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:10.148741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:10.150165 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:10.159481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1291/2562] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:11.661208 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:11.662610 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:11.675073 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d13419-366f-40ec-8156-6fd9011f0066 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:11.678596 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:11.679185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:11.679492 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:11.679768 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:11.736101 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:11.737466 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:11.746268 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1272/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:12.258512 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:12.267168 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43f64-751a-4566-b83d-19ede5076360 service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:12.270722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:12.271330 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:12.271655 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:12.271926 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:12.280694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:12.282092 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9374d-5211-4e2c-90cb-935a842cdac9 service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:12.291209 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1292/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:16.148516 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:16.209700 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cf4e7-ac31-424a-9dfd-e61d2c313cff service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:16.214046 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:16.214652 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:16.214959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:16.215217 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] PATH_INFO: `/v3/users/61706fbf156a4697b3f6c6a0b4906fca` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:16.216346 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61706fbf156a4697b3f6c6a0b4906fca)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:16.218234 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:16.264170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61706fbf156a4697b3f6c6a0b4906fca'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.264831 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61706fbf156a4697b3f6c6a0b4906fca'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.271604 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61706fbf156a4697b3f6c6a0b4906fca'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.272215 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61706fbf156a4697b3f6c6a0b4906fca'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.279185 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61706fbf156a4697b3f6c6a0b4906fca'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.289532 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:16.298877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1273/2565] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:16 2022] DELETE /identity/v3/users/61706fbf156a4697b3f6c6a0b4906fca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:16.303705 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:16.304157 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:16.304372 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:16.324462 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:16.325643 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:16.384134 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1293/2566] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:16.394370 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:16.395939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:16.452000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd953c2-e829-47d6-b274-c971014b3ff2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:16.455943 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:16.456544 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:16.456824 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:16.457098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:16.466220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:16.467722 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:16.477029 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1274/2567] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:16.740681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:16.742123 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:16.755928 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156645af-f81e-4ce6-acdf-b4bfb13ce36d None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:16.760647 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:16.761350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:16.761700 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:16.762306 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] PATH_INFO: `/v3/projects/0b2a71819f9b4b4eb626d47f64a5b1b2` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:16.763596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2a71819f9b4b4eb626d47f64a5b1b2)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:16.765923 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:16.813129 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2a71819f9b4b4eb626d47f64a5b1b2', 'request_id': 'req-cc59bd1e-d897-46f5-a3e2-9f275823c949'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.820277 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2a71819f9b4b4eb626d47f64a5b1b2', 'request_id': 'req-cc59bd1e-d897-46f5-a3e2-9f275823c949'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.826781 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2a71819f9b4b4eb626d47f64a5b1b2', 'request_id': 'req-cc59bd1e-d897-46f5-a3e2-9f275823c949'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.838068 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] The token cache is being invalidate because project 0b2a71819f9b4b4eb626d47f64a5b1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:16.838352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.839005 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.840849 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1294/2568] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:16 2022] DELETE /identity/v3/projects/0b2a71819f9b4b4eb626d47f64a5b1b2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:05:16.844961 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:16.854939 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bbe65-d71b-4390-abe9-131d752d6775 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:16.910665 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:16.911294 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:16.911581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:16.911847 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] PATH_INFO: `/v3/users/879ca7ae5b9541f6a5586d5ba75f3c18` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:16.912955 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879ca7ae5b9541f6a5586d5ba75f3c18)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:16.914849 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:16.962265 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879ca7ae5b9541f6a5586d5ba75f3c18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.962833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879ca7ae5b9541f6a5586d5ba75f3c18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.969881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879ca7ae5b9541f6a5586d5ba75f3c18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.970511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879ca7ae5b9541f6a5586d5ba75f3c18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.977546 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879ca7ae5b9541f6a5586d5ba75f3c18'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:16.995099 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1275/2569] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:16 2022] DELETE /identity/v3/users/879ca7ae5b9541f6a5586d5ba75f3c18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:17.259551 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:17.261079 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:17.274738 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59bd1e-d897-46f5-a3e2-9f275823c949 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:17.332710 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:17.333433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:17.333603 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:17.333875 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] PATH_INFO: `/v3/projects/53a3c3ec42c84c35b6acaa814045c3a7` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:17.334982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a3c3ec42c84c35b6acaa814045c3a7)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:17.336904 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:17.338328 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:17.385482 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a3c3ec42c84c35b6acaa814045c3a7', 'request_id': 'req-546a09a3-0c18-4090-a9b8-a1fb00569263'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.392686 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a3c3ec42c84c35b6acaa814045c3a7', 'request_id': 'req-546a09a3-0c18-4090-a9b8-a1fb00569263'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.398883 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a3c3ec42c84c35b6acaa814045c3a7', 'request_id': 'req-546a09a3-0c18-4090-a9b8-a1fb00569263'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.409693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] The token cache is being invalidate because project 53a3c3ec42c84c35b6acaa814045c3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:17.409976 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.410594 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.412094 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1295/2570] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:17 2022] DELETE /identity/v3/projects/53a3c3ec42c84c35b6acaa814045c3a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:17.416117 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:17.417514 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:17.430199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e80320-214e-4a89-bcd7-5d4808c393b1 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:17.441881 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:17.488921 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:17.489547 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:17.489827 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:17.490098 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] PATH_INFO: `/v3/users/2ce7f8b4b303421bbcc08eafd6c8d5e1` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:17.491205 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce7f8b4b303421bbcc08eafd6c8d5e1)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:17.493165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:17.539467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce7f8b4b303421bbcc08eafd6c8d5e1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.540113 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce7f8b4b303421bbcc08eafd6c8d5e1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.547145 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce7f8b4b303421bbcc08eafd6c8d5e1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.547797 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce7f8b4b303421bbcc08eafd6c8d5e1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.554724 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-f001326c-1bff-4e3b-ba98-c69f84c2a39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce7f8b4b303421bbcc08eafd6c8d5e1'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.571467 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1276/2571] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:17 2022] DELETE /identity/v3/users/2ce7f8b4b303421bbcc08eafd6c8d5e1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:17.842927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:17.844384 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:17.858284 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a09a3-0c18-4090-a9b8-a1fb00569263 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:17.913450 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:17.914075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:17.914350 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:17.914618 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] PATH_INFO: `/v3/projects/f19be96170c848bcab6c9eabfda1048c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:17.915749 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19be96170c848bcab6c9eabfda1048c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:17.917652 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:17.963494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19be96170c848bcab6c9eabfda1048c', 'request_id': 'req-f62c6c85-5d7b-4714-8d3e-c3d637da2691'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.971142 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19be96170c848bcab6c9eabfda1048c', 'request_id': 'req-f62c6c85-5d7b-4714-8d3e-c3d637da2691'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.977349 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19be96170c848bcab6c9eabfda1048c', 'request_id': 'req-f62c6c85-5d7b-4714-8d3e-c3d637da2691'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.988105 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] The token cache is being invalidate because project f19be96170c848bcab6c9eabfda1048c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:17.988387 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.989000 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-f62c6c85-5d7b-4714-8d3e-c3d637da2691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:17.990457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1296/2572] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:17 2022] DELETE /identity/v3/projects/f19be96170c848bcab6c9eabfda1048c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:17.995505 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:17.995816 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:17.996092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.016586 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:18.017775 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:18.075582 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1277/2573] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:18.083682 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.083968 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.084258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.104124 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:18.105248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:18.114073 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1297/2574] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:05:18.118162 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.127882 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69382b1-75c0-4992-8ecc-1ebb6784c50c None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.132401 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.132987 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.133261 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.133525 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] PATH_INFO: `/v3/domains` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.134159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 18:05:18.134460 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.136105 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.147898 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1278/2575] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Oct 14 18:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 18:05:18.152063 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.161699 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39296-4d74-4038-9451-d9e2fe53a6c6 None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.166272 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.166848 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.167122 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.167420 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.168630 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.170499 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.181317 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:18.201601 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1298/2576] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:18.202752 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.212907 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd0d7-0650-4d2f-92d1-4f40b08d3783 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.232223 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:18.271562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.272167 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.272443 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.272710 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.273323 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.275213 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.296511 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1279/2577] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:18.300511 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.311654 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfc29a-7121-470a-aca8-caa723d4ce86 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.316434 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.317059 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.317367 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.317638 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.318321 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.319961 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.330494 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1299/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:18.334123 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.344181 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74513f05-3633-4dc0-8a06-591a9c30018e admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.348906 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.349573 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.349854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.350124 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.350790 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.352462 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8942fc-669c-49fe-a350-e2ff99a5fcf1 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.363624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1280/2579] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:18.367631 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.378333 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721039ec-2a7c-4bc1-a279-2486de94d528 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.382992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.383672 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.383952 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.384224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] PATH_INFO: `/v3/projects/873525d7cb0645719009574acad6142e/users/e1850797ce854d3b8f08c74e77a42884/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.399775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=873525d7cb0645719009574acad6142e, user_id=e1850797ce854d3b8f08c74e77a42884, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.402564 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.415378 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1300/2580] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:18 2022] PUT /identity/v3/projects/873525d7cb0645719009574acad6142e/users/e1850797ce854d3b8f08c74e77a42884/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:18.426508 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.427036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.427036 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.455382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] MFA Rules not processed for user `e1850797ce854d3b8f08c74e77a42884`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:18.456581 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:18.519911 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1281/2581] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:18.524411 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.586285 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0444297-5148-4a76-ade7-f2b5c9dcaa3b admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.591646 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.592250 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.592528 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.592795 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.593428 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.595352 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.622046 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1301/2582] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:18.626063 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.636689 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65f50-725d-4702-a2d5-54e53422148d None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.694080 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.694687 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.694973 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.695220 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.695868 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.697795 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.720631 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1282/2583] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:18.723943 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.734760 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41caa25-7d97-4838-a96b-637fc248135a admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.739341 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.739927 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.740201 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.740465 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.741103 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.742689 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.753215 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1302/2584] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:18.757088 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.767429 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31f31-3cdf-46fc-aa5a-aeaacdf8c978 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.772173 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.772820 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.773119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.773417 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.774119 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.775825 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa63b1-ecd6-46f9-ae3d-2b19165e13d2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.786309 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1283/2585] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:18.790184 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:18.800576 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52848c6-b1bc-4c23-ae4c-0d08e1bde2ff admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:18.805194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:18.805828 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.806108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.806381 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] PATH_INFO: `/v3/projects/c304cc28a52b462a80b9206f7fc22700/users/ab91c82838c447519296d0d8db991476/roles/fe3e0f43a9894ab9a2c1553312375e0d` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.820852 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c304cc28a52b462a80b9206f7fc22700, user_id=ab91c82838c447519296d0d8db991476, role_id=fe3e0f43a9894ab9a2c1553312375e0d)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:18.823510 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:18.836596 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1303/2586] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:18 2022] PUT /identity/v3/projects/c304cc28a52b462a80b9206f7fc22700/users/ab91c82838c447519296d0d8db991476/roles/fe3e0f43a9894ab9a2c1553312375e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:18.848427 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:18.848712 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:18.848991 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:18.870708 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:18.880822 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] MFA Rules not processed for user `ab91c82838c447519296d0d8db991476`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:18.881976 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:18.946848 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1284/2587] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 18:05:18.952211 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.012924 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3e00-5e26-4edc-9991-dde372ac7ce6 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.017486 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.018076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.018354 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.018624 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.019248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.021162 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.032477 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:19.048457 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1304/2588] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Oct 14 18:05:18 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 18:05:19.052612 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.063731 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135995f0-59d5-4c3c-aa93-7fa767a6f580 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.119749 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.120345 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.120625 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.120896 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.121834 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.123789 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.145203 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1285/2589] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Oct 14 18:05:19 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 18:05:19.149137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.159932 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de735db-412d-49b1-b294-300dfcd585f8 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.164761 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.165353 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.165633 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.165955 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.166612 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.168284 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.179258 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1305/2590] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:19.183170 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.193382 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737b827-ee36-44e1-915e-d43f0e569ed2 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.197977 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.198623 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.198901 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.199705 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] PATH_INFO: `/v3/projects/89b5347d91c34e23a88308cfad625f07/users/5acf58f977c04e5487ee0915545f9086/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.214405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b5347d91c34e23a88308cfad625f07, user_id=5acf58f977c04e5487ee0915545f9086, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.217667 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.231028 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1286/2591] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:19 2022] PUT /identity/v3/projects/89b5347d91c34e23a88308cfad625f07/users/5acf58f977c04e5487ee0915545f9086/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:19.235009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.244917 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e2e9-e9b8-4992-82d3-e593d054c77f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.300911 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.301519 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.301798 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.302071 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.302742 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.304366 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedc0a9-26d0-485e-87c2-aa0be27ab6fb admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.314466 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1306/2592] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Oct 14 18:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 18:05:19.318521 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.328857 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0459db-95ba-42d5-b27d-5f51051a165b admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.333969 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.334613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.334889 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.335159 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] PATH_INFO: `/v3/projects/89b5347d91c34e23a88308cfad625f07/users/5acf58f977c04e5487ee0915545f9086/roles/87f9d55d22b7471e941216189675256a` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.337092 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b5347d91c34e23a88308cfad625f07, user_id=5acf58f977c04e5487ee0915545f9086, role_id=87f9d55d22b7471e941216189675256a)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.340360 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.350786 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1287/2593] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Oct 14 18:05:19 2022] PUT /identity/v3/projects/89b5347d91c34e23a88308cfad625f07/users/5acf58f977c04e5487ee0915545f9086/roles/87f9d55d22b7471e941216189675256a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:19.362363 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] REQUEST_METHOD: `POST` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.362681 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.362958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.390838 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.auth.core [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] MFA Rules not processed for user `5acf58f977c04e5487ee0915545f9086`. Rule list: `[]` (Enabled: `True`). {{(pid=81362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:19.392076 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:19.459461 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1307/2594] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:19.471242 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:19.473017 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:19.530489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8330447-2685-430c-851f-5b546dd13abb admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:19.534097 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:19.534680 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:19.534950 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:19.535209 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:19.539194 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:19.591971 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:19.593441 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:19.602207 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1288/2595] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:21.103507 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:21.104891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:21.117424 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358da40-7c5d-4325-93d8-59a9d2684c5e None None] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:21.120958 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:21.121701 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:21.121982 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:21.122283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:21.178090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:21.179558 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:21.184249 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:21.189300 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1308/2596] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:21.712152 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:21.721317 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fae08-8dad-4d6b-abda-b1e5dbd69874 service cinder] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:21.724854 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb70aefb254402ea472c80b81124cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:21.725433 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:21.725701 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:21.725965 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:21.735651 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:21.737083 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68770dec-3a32-44fc-8524-f675e1ef28bc service cinder] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:21.746743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1289/2597] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:25.602473 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:25.663265 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d3d4-7a4d-484e-b577-8c5998e0064d service cinder] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:25.668331 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:25.669009 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:25.669288 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:25.669553 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] PATH_INFO: `/v3/users/e1850797ce854d3b8f08c74e77a42884` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:25.670657 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1850797ce854d3b8f08c74e77a42884)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:25.672580 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:25.754144 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1850797ce854d3b8f08c74e77a42884'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:25.754730 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1850797ce854d3b8f08c74e77a42884'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:25.762433 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1850797ce854d3b8f08c74e77a42884'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:25.763060 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1850797ce854d3b8f08c74e77a42884'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:25.770276 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1850797ce854d3b8f08c74e77a42884'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:25.787790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1309/2598] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:25 2022] DELETE /identity/v3/users/e1850797ce854d3b8f08c74e77a42884 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:25.792196 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] REQUEST_METHOD: `POST` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:25.792682 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:25.792853 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:25.811403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.auth.core [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] MFA Rules not processed for user `cf4c2ccaa5c44feca15e4abc0bc69573`. Rule list: `[]` (Enabled: `True`). {{(pid=81361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 18:05:25.812588 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:25.870638 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1290/2599] 10.222.0.26 () {58 vars in 958 bytes} [Fri Oct 14 18:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 18:05:25.880108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:25.881517 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:25.938252 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e26f38-42c9-401a-999a-9dd4a221b73f admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:25.941882 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:25.942481 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:25.942755 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:25.943021 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:25.952313 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:25.953722 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:25.963226 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1310/2600] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:05:26.232618 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:26.234069 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:26.246386 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b608d7-e316-4a7f-ae70-710b633ded32 None None] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:26.251184 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:26.251841 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:26.252118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:26.252949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] PATH_INFO: `/v3/projects/873525d7cb0645719009574acad6142e` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:26.254263 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873525d7cb0645719009574acad6142e)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:26.256190 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:26.302727 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873525d7cb0645719009574acad6142e', 'request_id': 'req-6f64cfd5-170f-453b-b58e-d89c977e2d41'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.309236 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873525d7cb0645719009574acad6142e', 'request_id': 'req-6f64cfd5-170f-453b-b58e-d89c977e2d41'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.316199 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873525d7cb0645719009574acad6142e', 'request_id': 'req-6f64cfd5-170f-453b-b58e-d89c977e2d41'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.326613 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] The token cache is being invalidate because project 873525d7cb0645719009574acad6142e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:26.326918 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.327560 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.329047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1291/2601] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:26 2022] DELETE /identity/v3/projects/873525d7cb0645719009574acad6142e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:26.333259 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:26.343508 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5109-2165-4404-baeb-9a0fb2922073 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:26.362664 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:26.401837 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:26.402992 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:26.403271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:26.403571 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] PATH_INFO: `/v3/users/ab91c82838c447519296d0d8db991476` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:26.404694 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab91c82838c447519296d0d8db991476)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:26.406599 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:26.450957 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab91c82838c447519296d0d8db991476'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.451590 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab91c82838c447519296d0d8db991476'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.458683 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab91c82838c447519296d0d8db991476'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.459314 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab91c82838c447519296d0d8db991476'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.465693 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab91c82838c447519296d0d8db991476'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.483224 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1311/2602] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:26 2022] DELETE /identity/v3/users/ab91c82838c447519296d0d8db991476 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:26.752477 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:26.754001 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:26.768249 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64cfd5-170f-453b-b58e-d89c977e2d41 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:26.780000 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:26.826948 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:26.827593 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:26.827813 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:26.828084 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] PATH_INFO: `/v3/projects/c304cc28a52b462a80b9206f7fc22700` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:26.829200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c304cc28a52b462a80b9206f7fc22700)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:26.831405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:26.877624 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c304cc28a52b462a80b9206f7fc22700', 'request_id': 'req-c97713b0-f702-45e0-91a7-423556faeaa3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.883699 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c304cc28a52b462a80b9206f7fc22700', 'request_id': 'req-c97713b0-f702-45e0-91a7-423556faeaa3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.890959 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c304cc28a52b462a80b9206f7fc22700', 'request_id': 'req-c97713b0-f702-45e0-91a7-423556faeaa3'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.901577 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] The token cache is being invalidate because project c304cc28a52b462a80b9206f7fc22700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:26.902412 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.903048 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:26.904578 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1292/2603] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:26 2022] DELETE /identity/v3/projects/c304cc28a52b462a80b9206f7fc22700 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:26.908537 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:26.909925 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:26.923339 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcace0b4-db40-4e8b-912e-fce5666b451c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:26.979017 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:26.979661 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:26.979944 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:26.980824 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] PATH_INFO: `/v3/users/5acf58f977c04e5487ee0915545f9086` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:26.982248 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acf58f977c04e5487ee0915545f9086)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:26.984194 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:27.027676 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:27.030155 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acf58f977c04e5487ee0915545f9086'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.031070 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acf58f977c04e5487ee0915545f9086'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.039392 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acf58f977c04e5487ee0915545f9086'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.040020 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acf58f977c04e5487ee0915545f9086'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.047010 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acf58f977c04e5487ee0915545f9086'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.065062 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1312/2604] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:05:26 2022] DELETE /identity/v3/users/5acf58f977c04e5487ee0915545f9086 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:27.580688 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:27.582343 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:27.599692 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97713b0-f702-45e0-91a7-423556faeaa3 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:27.657757 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:27.658403 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:27.658662 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:27.658928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] PATH_INFO: `/v3/projects/89b5347d91c34e23a88308cfad625f07` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:27.660500 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b5347d91c34e23a88308cfad625f07)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:27.662454 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:27.707405 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:27.708922 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b5347d91c34e23a88308cfad625f07', 'request_id': 'req-9e66ee30-c29a-4c35-961c-ac41394f4e5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.717785 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b5347d91c34e23a88308cfad625f07', 'request_id': 'req-9e66ee30-c29a-4c35-961c-ac41394f4e5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.725498 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b5347d91c34e23a88308cfad625f07', 'request_id': 'req-9e66ee30-c29a-4c35-961c-ac41394f4e5d'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.736884 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] The token cache is being invalidate because project 89b5347d91c34e23a88308cfad625f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:05:27.737168 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.737783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:05:27.739253 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1293/2605] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:05:27 2022] DELETE /identity/v3/projects/89b5347d91c34e23a88308cfad625f07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:05:37.061337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:37.733980 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:05:57.324937 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:57.327216 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:57.400834 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f2f8c-7a28-4c96-96ab-5f21a5a78a9c admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:57.447949 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:57.450176 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:57.459637 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:57.460696 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:57.460981 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:57.461711 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:57.464137 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:57.480192 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:57.482177 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:57.493918 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1313/2606] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 18:05:57.513111 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ee30-c29a-4c35-961c-ac41394f4e5d admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:57.517171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:57.517783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:57.518065 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:57.518338 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:57.520126 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:57.593833 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:57.595289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:57.607289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1294/2607] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 18:05:58.790097 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:05:58.791562 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:58.802718 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02eb9e-819b-4998-8b48-cbf8470a3665 service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:05:58.806334 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adb92f3a165d47daa47b9de4707b1792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:05:58.806951 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] REQUEST_METHOD: `GET` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:05:58.807223 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:05:58.807523 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:05:58.809796 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:05:58.822806 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:05:58.824283 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:05:58.835153 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1314/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:05:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:06:07.602014 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=54 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:06:07.633104 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:06:07.634539 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:06:07.714592 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db9d1-20fe-4efc-8bc9-ab8b4e7f43b6 service neutron] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:06:07.719226 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:06:07.719886 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:06:07.720165 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:06:07.720435 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] PATH_INFO: `/v3/users/8c0fecd5e9a34a8eacf8bafe5b16ca48` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:06:07.721555 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0fecd5e9a34a8eacf8bafe5b16ca48)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:06:07.723507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:06:07.771047 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0fecd5e9a34a8eacf8bafe5b16ca48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:07.771804 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0fecd5e9a34a8eacf8bafe5b16ca48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:07.778716 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0fecd5e9a34a8eacf8bafe5b16ca48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:07.779349 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0fecd5e9a34a8eacf8bafe5b16ca48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:07.786678 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0fecd5e9a34a8eacf8bafe5b16ca48'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:07.804634 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1295/2609] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:06:07 2022] DELETE /identity/v3/users/8c0fecd5e9a34a8eacf8bafe5b16ca48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:06:07.981002 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:06:07.991337 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e987e0-2017-4966-ab62-441e67e9792c service neutron] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:06:08.048108 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:06:08.048724 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:06:08.048996 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:06:08.049260 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] PATH_INFO: `/v3/projects/2c516c53c42d435b8e334d726ea42147` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:06:08.050355 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c516c53c42d435b8e334d726ea42147)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:06:08.052271 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:06:08.096787 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:06:08.098043 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c516c53c42d435b8e334d726ea42147', 'request_id': 'req-5da39187-cbb7-4627-81be-60ed96a94d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.106736 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c516c53c42d435b8e334d726ea42147', 'request_id': 'req-5da39187-cbb7-4627-81be-60ed96a94d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.113090 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c516c53c42d435b8e334d726ea42147', 'request_id': 'req-5da39187-cbb7-4627-81be-60ed96a94d21'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.123472 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] The token cache is being invalidate because project 2c516c53c42d435b8e334d726ea42147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:06:08.123758 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.124400 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.125866 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1315/2610] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:06:07 2022] DELETE /identity/v3/projects/2c516c53c42d435b8e334d726ea42147 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:06:08.129869 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:06:08.131264 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:06:08.145122 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bf72b-a6d1-420f-88f2-26b38da32b44 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:06:08.200310 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:06:08.200928 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:06:08.201202 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:06:08.201465 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] PATH_INFO: `/v3/users/29009d4768594beba155470ed7f67261` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:06:08.202562 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29009d4768594beba155470ed7f67261)` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:06:08.204783 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:06:08.228507 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:06:08.253888 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29009d4768594beba155470ed7f67261'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.254545 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29009d4768594beba155470ed7f67261'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.261607 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29009d4768594beba155470ed7f67261'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.262293 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29009d4768594beba155470ed7f67261'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.269289 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.notifications [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29009d4768594beba155470ed7f67261'} {{(pid=81361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.287121 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1296/2611] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Oct 14 18:06:08 2022] DELETE /identity/v3/users/29009d4768594beba155470ed7f67261 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 18:06:08.465064 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Authenticating user token {{(pid=81362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:06:08.466635 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.fernet_utils [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:06:08.480075 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39187-cbb7-4627-81be-60ed96a94d21 admin admin] Validating token access rules against request {{(pid=81362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:06:08.537608 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4c2ccaa5c44feca15e4abc0bc69573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8a3a4fbbeb945ec99d62464efbbf393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:06:08.538230 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:06:08.538502 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:06:08.538766 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] PATH_INFO: `/v3/projects/a02b86e034164fb48da84789ad3cca9c` {{(pid=81362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:06:08.539891 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02b86e034164fb48da84789ad3cca9c)` {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:06:08.541790 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] RBAC: Authorization granted {{(pid=81362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:06:08.585775 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02b86e034164fb48da84789ad3cca9c', 'request_id': 'req-c1cefe5e-6614-4762-8985-11b1efc5e1d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.593221 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02b86e034164fb48da84789ad3cca9c', 'request_id': 'req-c1cefe5e-6614-4762-8985-11b1efc5e1d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.599741 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02b86e034164fb48da84789ad3cca9c', 'request_id': 'req-c1cefe5e-6614-4762-8985-11b1efc5e1d4'} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.610256 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] The token cache is being invalidate because project a02b86e034164fb48da84789ad3cca9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 18:06:08.610545 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.611176 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG keystone.notifications [None req-c1cefe5e-6614-4762-8985-11b1efc5e1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 18:06:08.612691 dv-cinder-749155-15-smb devstack@keystone.service[81362]: [pid: 81362|app: 0|req: 1316/2612] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Oct 14 18:06:08 2022] DELETE /identity/v3/projects/a02b86e034164fb48da84789ad3cca9c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 18:06:18.283659 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:06:18.607268 dv-cinder-749155-15-smb devstack@keystone.service[81362]: DEBUG dbcounter [-] [81362] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 18:08:28.497489 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Authenticating user token {{(pid=81361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 18:08:28.498877 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:08:28.566900 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bceea-0dd8-492a-97b5-1c7e3f43f8a4 admin admin] Validating token access rules against request {{(pid=81361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 18:08:28.624329 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233bd3bd3a8f4d8484a6873a61cab231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fdbf2b97ec41f99a8035432829bb5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 18:08:28.624929 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] REQUEST_METHOD: `GET` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 18:08:28.625200 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 18:08:28.625464 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 18:08:28.627171 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.fernet_utils [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 18:08:28.638743 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 18:08:28.640332 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699426b1-d335-4599-b29d-c9a54682a5c2 service placement] RBAC: Authorization granted {{(pid=81361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 18:08:28.650118 dv-cinder-749155-15-smb devstack@keystone.service[81361]: [pid: 81361|app: 0|req: 1297/2613] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Oct 14 18:08:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 18:08:38.645776 dv-cinder-749155-15-smb devstack@keystone.service[81361]: DEBUG dbcounter [-] [81361] Writing DB stats keystone:SELECT=58 {{(pid=81361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}